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ABSTRACT 

The neural network structures developed in this thesis 
demonstrate the ability of parallel distributed processing in 
solving adaptive control problems. Adaptive control theory 
implies a combination of a control method and a model 
estimation. The control method investigated is the Lyapunov 
Model Reference Adaptive Control or MRAC and the model 
estimation investigated is the linear least square estimator. 
The neural network theory is introduced with emphasis on the 
back-propagation algorithm. The implementation of the neural 
network adaptive control structure is demonstrated on the 
longitudinal dynamics of the X-29 fighter aircraft. Three 
configurations are proposed to train the neural network 
adaptive control structures to provide the appropriate inputs 
to the unstable X-29 plant so that desired responses could be 
obtained. These configurations are presented in eight cases, 
which emulates stable systems like the X-29 closed-loop plant 
or the optimal and the limited X-29 controllers, and unstable 
systems like the X-29 plant or its inverse. 



iv 



TABLE OF CONTENTS 



I. INTRODUCTION 1 

II. NEURAL NETWORK THEORY 3 

A. ANALOGY TO THE BRAIN 3 

B. NEURAL NETWORK ARCHITECTURE 5 

1. Processing Elements 5 

2. Activation Function Logic 7 

3. Learning Rule 10 

4. Recall Rule 11 

C. BACKPROPAGATION ALGORITHM 11 

1. The Global Error Function 12 

2. Backpropagation Summary 14 

III. ADAPTIVE CONTROL SYSTEMS 16 

A. TWO TRADITIONAL ADAPTIVE CONTROL METHODS 16 

B. ONE STEP AHEAD PREDICTION CONTROL 19 

C. LINEAR LEAST SQUARE ESTIMATION 2 2 

IV. X-29 MODERN AIRCRAFT 27 

A. FIGHTER DESCRIPTION 27 

B. H 2 AND H ro CONTROLLERS 32 

1. Optimal-Performance Model 34 

a. Time Domain 37 

b. Frequency Domain 37 



v 



2. Limited-Performance Model 41 

a. Time Domain 42 

b. Frequency Domain 42 

V. EXPERIMENTAL SET-UP 46 

A. HARDWARE AND SOFTWARE REQUIRED 46 

1. Hardware 46 

2. Software 47 

B. MODEL DESIGN CONSIDERATIONS 49 

1. Design Objectives 49 

a. Input Spectrum 50 

b. Aliasing and Sampling Time 50 

c. Data Record Length 52 

2. Model Structure Selection 53 

a. SIMO Model Neural Network Structure 54 

b. MIMO Model Neural Network Structure 56 

3. Configurations 56 

a. Simulation of the Closed-Loop Plant 57 

b. Identification of the Inverse Plant 59 

c. Simulations of the Existing Controllers 

and of the Plant 65 

VI. RESULTS AND DISCUSSION 69 

A. CONFIGURATION /l: SIMULATION OF THE X-29 

CLOSED-LOOP PLANT 69 

1. Case #1 - Optimal Performance X-29 

Closed-Loop Plant 69 



2. Case #2 - Limited Performance X-29 

Closed-Loop Plant 77 

B. CONFIGURATION #2: IDENTIFICATION OF THE 

INVERSE PLANT 84 

1. Case #3 - Inverse Closed-Loop Plant of the 

Optimal Performance X-29 Model 84 

2. Case #4 - Inverse Plant of the A-4D 

Aircraft 93 

3 . Case #5 - Inverse Plant of the X-29 

Aircraft 101 

C. CONFIGURATION #3: SIMULATIONS OF THE X-29 

EXISTING CONTROLLERS AND THE X-29 PLANT 106 

1. Case #6 - Simulation of the X-29 Optimal 

Controller and the X-29 Plant 107 

2. Case #7 - Simulation of the X-29 Limited 

Controller and the X-29 Plant 121 

3. Case #8 - Closure of the Open-Loop Model 
of the Optimal Controller of Case #6 and 

of the Limited Controller of Case #7 124 

VII. CONCLUSIONS AND RECOMMENDATIONS 128 

REFERENCES 131 

APPENDIX A: NEURALWORKS PROFESSIONAL II USERIO PROGRAM.. 133 

APPENDIX B: NEURALWORKS PROFESSIONAL II CONTROL 

STRATEGY FILES 147 

APPENDIX C: NEURALWORKS PROFESSIONAL II HEADER 

FILES 152 



Vll 



APPENDIX D: MATLAB M-FILES 



175 



APPENDIX E: TABLE OF CONFIGURATIONS AND CASES 184 

INITIAL DISTRIBUTION LIST 185 



viii 



LIST OF TABLES 



TABLE I: UNCOMPENSATED X-29 MODEL STATES 31 

TABLE II: UNCOMPENSATED X-29 OPEN LOOP POLES 31 

TABLE III: X-29 OPTIMAL PERFORMANCE CLOSED LOOP POLES 35 

TABLE IV: X-2 9 LIMITED PERFORMANCE CLOSED LOOP POLES 41 



ix 



LIST OF FIGURES 



Figure 1: Biological Neuron 4 

Figure 2: Building Blocks of Neural Computing Network 5 

Figure 3: A Simple Neural Network Architecture .....6 

Figure 4: Neural Networks Professional II Activation 

Function Logic 8 

Figure 5: Sigmoidal Logistic Function 8 

Figure 6: Hyperbolic Tangent Function 10 

Figure 7: Self-Tuning Regulator Control Block Diagram. ... 17 

Figure 8: Model Reference Adaptive Control Block Diagram. 18 

Figure 9: Grumman X-29 FSW Demonstrator 28 

Figure 10: Uncompensated X-29 Open Loop Configuration 30 

Figure 11: Feedback Configuration of the Compensated 

X-29 33 

Figure 12: Precision Control Modes 36 

Figure 13: Q and a Time Responses to Input 1 

(Optimal case) 38 

Figure 14 : Q and a Time Responses to Input 2 

(Optimal case) 38 

Figure 15: Continuous and Discrete a Frequency Responses 

to Input 1 (Optimal Case) 39 

Figure 16: Continuous and Discrete Q Frequency Responses 

to Input 1 (Optimal Case) 39 



x 



Figure 17: Continuous and Discrete a Frequency Responses 

to Input 2 (Optimal Case) 40 

Figure 18: Continuous and Discrete q Frequency Responses 

to Input 2 (Optimal Case) 40 

Figure 19: Q and a Time Responses to Input 1 

(Limited Case) 43 

Figure 20: Q and a Time Responses to Input 2 

(Limited Case) 43 

Figure 21: Continuous and Discrete a Frequency Responses 

to Input 1 (Limited Case) .44 

Figure 22: Continuous and Discrete q requency Responses 

to Input 1 (Limited Case) 44 

Figure 23: Continuous and Discrete a Frequency Responses 

to Input 2 (Limited Case) 45 

Figure 24: Continuous and Discrete q Frequency Responses 

to Input 2 (Limited Case) 45 

Figure 25: Poles and Zeros of the X-29 Closed-Loop Plant.. 52 

Figure 26: SIMO Neural Network Model Structure 54 

Figure 27: MIMO Neural Network Model Structure 56 

Figure 28: Closed-Loop Architecture 57 

Figure 29: Inverse Plant Architecture 60 

Figure 30: Poles and Zeros of the A-4D Plant 62 

Figure 31: Poles and Zeros of the X-29 Plant 63 

Figure 32: Configuration #2: Identification of the 

Inverse Plant 64 

Figure 33: Open-Loop Architecture .65 



xi 



Figure 34: Configuration #3: Simulation of the Existing 

Controllers and the X-29 Plant 67 

Figure 35: X-29 Model and Network a Frequency Responses 

to Input 1 ( Optimal case) 72 

Figure 36: X-29 Model and Network q Frequency Responses 

to Input 1 ( Optimal case) 72 

Figure 37: X-29 Model and Network a Frequency Responses 

to Input 2 ( Optimal case) 73 

Figure 38: X-29 Model and Network q Frequency Responses 

to Input 2 ( Optimal case) 73 

Figure 39: RMS Prediction Errors for a 74 

Figure 40: RMS Prediction Errors for q 74 

Figure 41: X-29 Model and Network a Time Responses 

to Input 1 ( Optimal case) 75 

Figure 42: X-29 Model and Network q Time Responses 

to Input 1 ( Optimal case) 75 

Figure 43: X-29 Model and Network a Time Responses 

to Input 2 ( Optimal case) 76 

Figure 44: X-29 Model and Network q Time Responses 

to Input 2 ( Optimal case) 76 

Figure 45: X-29 Model and Network a Frequency Responses 

to Input 1 (Limited case) 79 

Figure 46: X-29 Model and Network q Frequency Responses 

to Input 1 ( Limited case) 79 

Figure 47: X-29 Model and Network a Frequency Responses 

to Input 2 ( Limited case) 80 



Xll 



Figure 48: X-29 Model and Network q Frequency Responses 

to Input 2 ( Limited case) 80 

Figure 49: RMS Prediction Errors for a 81 

Figure 50: RMS Prediction Errors for q 81 

Figure 51: X-29 Model and Network a Time Responses 

to Input 1 ( Limited case) 82 

Figure 52: X-29 Model and Network q Time Responses 

to Input 1 ( Limited case) 82 

Figure 53: X-29 Model and Network a Time Responses 

to Input 2 ( Limited case) 83 

Figure 54: X-29 Model and Network q Time Responses 

to Input 2 ( Limited case) 83 

Figure 55: RB Input Comparisons after 2000 Epochs 

(case #3) 88 

Figure 56: RMS Prediction Errors after 2000 Epochs 

(case #3) 88 

Figure 57: RB Input Comparisons after 150K Epochs 

(case #3) 89 

Figure 58: RMS Prediction Errors after 150K Epochs 

(case #3 ) 89 

Figure 59: RB Input Comparisons after 250K Epochs 

(case #3 ) 90 

Figure 60: RMS Prediction Errors after 250K Epochs 

(case #3 ) 90 

Figure 61: RB Input Comparisons after 450K Epochs 

(case #3) 91 



xiii 



91 



Figure 62: RMS Prediction Errors after 450K Epochs 

( case #3 ) 

Figure 63: X-29 Inverse Plant Model and Network 2 a 

Frequency Responses to Input 1 (Optimal case).. 92 
Figure 64: X-29 Inverse Plant Model and Network 2 q 

Frequency Responses to Input 1 (Optimal case).. 92 
Figure 65: RB Input Comparisons after 25K Epochs 

(case #4) 96 

Figure 66: RMS Prediction Errors after 25K Epochs 

( case #4 ) 96 

Figure 67: A-4D Plant Model and Network 1 u Frequency 

Responses 97 

Figure 68: A-4D Plant Model and Network 1 a Frequency 

Responses 97 

Figure 69: A-4D Plant Model and Network 1 q Frequency 

Responses 98 

Figure 70: A-4D Plant Model and Network 1 theta Frequency 

Responses 98 

Figure 71: A-4D Plant Model and Network 2 u Frequency 

Responses 99 

Figure 72: A-4D Plant Model and Network 2 a Frequency 

Responses 99 

Figure 73: A-4D Plant Model and Network 2 q Frequency 

Responses 100 

Figure 74: A-4D Plant Model and Network 2 theta Frequency 

Responses 100 



xiv 



Figure 75: 



Figure 76: 



Figure 77: 



Figure 78: 



Figure 79: 



Figure 80: 



Figure 81: 



Figure 82: 



Figure 83: 



Figure 84: 



Figure 85: 



Figure 86: 



Figure 87: 



X-29 Plant Model and Network 1 a Time 

Responses to Input 1 104 

X-29 Plant Model and Network 1 q Time 

Responses to Input 1 104 

X-29 Plant Model and Network 1 a Frequency 

Responses to Input 1 105 

X-29 Plant Model and Network 1 q Frequency 

Responses to Input 1 105 

RB Input Comparisons after 500K Epochs 

(case #5) 106 



X-29 Optimal Controller 
Time Responses to Input 
X-29 Optimal Controller 
Time Responses to Input 
X-29 Optimal Controller 
Time Responses to Input 
X-29 Optimal Controller 
Time Responses to Input 
X-29 Optimal Controller 
Time Responses to Input 
X-29 Optimal Controller 
Time Responses to Input 
X-29 Optimal Controller 
Time Responses to Input 
X-29 Optimal Controller 
Time Responses to Input 



Model and Network 1 a 
1 (0 Hidden layer ).... Ill 
Model and Network 1 q 

1 (0 Hidden layer ).... 112 
Model and Network 1 a 

2 (0 Hidden layer ).... 112 
Model and Network 1 q 

2 (0 Hidden layer ).... 113 
Model and Network 1 a 
1 (1 Hidden layer ).... 113 
Model and Network 1 q 

1 (1 Hidden layer ).... 114 
Model and Network 1 a 

2 (1 Hidden layer) 114 

Model and Network 1 q 

2 (1 Hidden layer ).... 115 



xv 



Figure 


88 : 


Figure 


89 : 


Figure 


90: 


Figure 


91: 


Figure 


92 : 


Figure 


93 : 


Figure 


94 : 


Figure 


95: 


Figure 


96: 


Figure 


97 : 


Figure 


98: 


Figure 


99: 


Figure 


100 


Figure 


101 


Figure 


102 



SVD Plot of the Wgt Matrix (30 elements) 115 

SVD Plot of the Wgt Matrix (21 elements) 116 

SVD Plot of the Wgt Matrix (12 elements) 116 

SVD Plot of the Wgt Matrix (5 elements) 117 

X-29 Optimal Controller Model and Network 1 a 
Time Responses to Input 1 (2 Hidden layer ).... 117 
X-29 Optimal Controller Model and Network 1 q 
Time Responses to Input 1 (2 Hidden layer ).... 118 
X-29 Optimal Controller Model and Network 1 a 
Time Responses to Input 2 (2 Hidden layer ).... 118 
X-29 Optimal Controller Model and Network 1 q 
Time Responses to Input 2 (2 Hidden layer ).... 119 
X-29 Plant Model and Network 2 a Time 

Responses to Input 2 119 

X-29 Plant Model and Network 2 q Time 

Responses to Input 2 120 

X-29 Limited Controller Model and Network 1 a 

Time Responses to Input 1 122 

X-29 Limited Controller Model and Network 1 q 

Time Responses to Input 1 122 

: X-29 Optimal Controller Model and Network 1 a 

Time Responses to Input 2 123 

: X-29 Limited Controller Model and Network 1 q 

Time Responses to Input 2 12 3 

: X-29 Closed-Loop Model and Networks a Time 

Responses to Input 1 (Limited case) 126 



xvi 



Figure 103: X-29 Closed-Loop Model and Networks q Time 

Responses to Input 1 (Limited case) 126 

Figure 104: X-29 Closed-Loop Model and Networks a Time 

Responses to Input 2 (Limited case) 127 

Figure 105: X-29 Closed-Loop Model and Networks q Time 

Responses to Input 2 (Limited case) 127 



xvii 



ACKNOWLEDGEMENTS 



At this point of my thesis I would like to take the time 
and express my appreciation to those who contributed to the 
completion of this thesis. A special thank you goes to 
Professor Dan Collins, my thesis advisor, who suggested the 
topic of the thesis and provided the right amount of guidance 
to accomplish this research. 

A thank you is also extended to Professor Louis Schmidt, 
who served as the second reader to this document, and to LCDR 
Shahar Dror, with whom I shared my laborious problems, and 
from whom I received valuable ideas. Dear Shahar, my wife 
Monika and I thankfully accept your invitation and promise you 
on this day, December 8, 1991, that we will visit your 
beautiful country Isreal in the near future. 

A most sincere thank you goes to my pearl, my lovely wife 
Monika who I met here in Monterey, and whose constant 
motivation and love was a significant contribution to this 
thesis. Although her Austrian heritage made German her mother 
tongue, she conquered the English language so respectably that 
without her linguistic support, this French-Canadian, myself, 
would still find himself struggling with the English grammar. 



xviii 



I. INTRODUCTION 



The parallel distributed processing structure of neural 
networks provides the models for solving adaptive control 
problems, as demonstrated in Ref. 1. Adaptive control involves 
a self-learning controller which has the ability to adjust 
itself in order to compensate for system changes. The control 
and estimation functions of adaptive control will be 
implemented on the H 2 and controllers and on the plant of 
the X-29 [Ref. 2] . 

Three configurations are proposed for training the neural 
networks to provide the appropriate inputs to the X-29 plant 
in which desired responses are obtained. 

This thesis will investigate the applications of methods 
that are based on neural network adaptive control theory to 
the reduced order, linearized longitudinal dynamics model of 
the X-29 aircraft. Chapter II introduces neural network theory 
and the backpropagation algorithm. In Chapter III, two 
traditional adaptive control methods will be briefly 
discussed, a one-step-ahead control algorithm will be used to 
design the control model, and a linear least square estimation 
algorithm will be implemented to design the estimator model. 
Chapter IV presents a description of the fighter as well as 
the H 2 and H ro controllers that were designed to solve the 
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subsonic longitudinal instability of that aircraft. Chapter V 
describes the hardware and software used for the experimental 
set-up, in addition to model design considerations which 
include design objectives, model structures selection, and 
configurations. Chapter VI presents the results of the three 
configurations' simulations. Finally, Chapter VII concludes 
with some remarks on what has been achieved and what is 
recommended for further studies. 
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II. NEURAL NETWORK THEORY 



A. ANALOGY TO THE BRAIN 

Both the brain and the digital computer operate on 
electrical signals, perform computational functions and are 
composed of a very large number of simple elements. The major 
difference is in the signal transmission time scale. The 
computer involves microsecond or even nanosecond time scales 
to transmit a signal compared to the slow nerve impulses. 
Nevertheless, the advantage of the brain is, that its huge 
computation rate is achieved by an enormous amount of parallel 
units which surpass any modern computer system. 

Neural network elements are inspired by the elementary 
functions of the biological neuron. They are organized in such 
a way that they exhibit some characteristics of the human 
brain. That is, they have the ability to learn from 
experience, to perform abstractions of inputs with relevant 
information, and to generalize their knowledge from previous 
results . 

By learning we mean that the neural network can modify its 
behavior from the environment's response. The neural network 
will self-adjust its weights to produce the desired output. 

By abstraction we mean the ability to obtain idealized 
prototypes from a given set of inputs. 
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By generalization we mean that the neural network trained 
on input and output examples can produce a reasonable output 
to an input differing from those it was trained on. 

Figure 1 shows the typical neuron. The neuron consists of 
three sections: the dendrites, the cell body, and the axon. 
[Ref. 3] 



The dendrites receive signals from other neurons through 
the synapses, the connection points. These inputs are 
multiplied by the corresponding weight, the synapse strength, 
and then summed in the cell body to determine if their 
excitation level exceeds the specified threshold. On the 
affirmative, the cell fires and sends a signal to the other 
neurons through the axons. 




Figure 1 Biological Neuron 
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B. NEURAL NETWORK ARCHITECTURE 

In a neural network, we refer to the neuron as a 
processing element, PE. As shown in Fig. 2, the input paths 
are comparable to the dendrites, the summation operation and 
the transfer function to the cell body, and the output paths 
to the axon. [Ref. 4] 




Figure 2 Building Blocks of Neural Computing Network 

1. Processing Elements 

A processing element is a simple computational unit 
which receives data from its input side, processes that data 
through a summation operation and a transfer function, and 
then sends the result to the neighboring processing elements 
from its output side. Figure 3 represents a simple neural 
network architecture. Many processing elements are grouped 
into layers and are either fully or randomly connected to the 
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processing elements of the successive layers. These 
connections determine in what manner the processing elements 
will react with each other. 

The neural networks for this research consist of 
feedforward networks in which the connections feed the 
information in only one direction. No recurrent layers or 
feedback loops from a processing element to a previous one 
will be considered. 




Figure 3 A Simple Neural Network Architecture 

The first layer is the input buffer, which presents 
the information to the network. The last layer is the output 
buffer, which contains the response of the network to the 
given input. Intermediate layers are referred to as hidden 
layers . 
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Referring to control theory in state space, the input 
buffer elements correspond to the elements of the input 
variable, the output buffer elements to the ones of the output 
variable, and the hidden units to the elements of the state 
variable . 

At any given time, each processing element has a 
certain level of activation. The pattern and the level of 
these activations determine the state of the system at that 
given point. 

2. Activation function Logic 

Neuralworks Professional II/ Plus® development 
software contains an activation function logic, shown in Fig. 
4, which demonstrates the complexity of the activation 
function of the system. The use of complex activation 
functions may help the network to solve various nonlinear 
systems. Activations may include a summation function, a 
transfer function, a noise generator, scaling, limiting, 
thresholding, and an output function. [Ref. 4] 

The transfer function could be simply- a linear, or 
some monotonic function like the sigmoid and hyperbolic 
tangent functions. A nonlinear network can be achieved by 
using any of the last two functions since they provide 
nonlinear responses. 
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Figure 4 Neural networks Professional II 
Activation Function Logic 



The sigmoid function, as shown in Fig. 5, is a 
logistic or "squashing" function. NET is equivalent to x in 
the following notation. 



(LOGISTIC FUNCTION) 
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Figure 5 Sigmoidal Logistic Function 
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The sigmoid function is expressed as, 



OUT = 1 / (l+e~ x ) (2.1) 

Its derivative can be simply represented in terms of itself, 

OUT' = e~ x / (l+e~ x ) 2 

or OUT' (x) = out (x) * (1-out (x) ) (2.2) 

which saves a large amount of computation time. Equation (2.2) 
defines a nonlinear gain that solves the noise-saturation 
dilemma of Grossberg (1973); that is, it permits the network 
to handle both, small and large signals. The central region of 
high gain helps the small input signals to be processed, while 
the decreasing slope or gain at both, negative and positive 
extremes, are adequate for large signals. 

Another nonlinear activation function which is often 
used is the hyperbolic tangent function shown in Fig. 6. It is 
expressed as follows: 

OUT = tanh(x) or OUT = (e x -e~ x ) / (e x +e~ x ) (2.3) 



9 




Figure 6 Hyperbolic Tangent Function 

As with the sigmoid function, its derivative can also be 
expressed in terms of itself: 

OUT' (x) = (1+oat (x) ) * (1-out (x) ) (2.4) 

3. Learning rule 

There are two distinct phases in the operation of the 
network: learning and recall. Three types of learning exist: 
supervised, unsupervised, and reinforcement. 

Supervised learning involves modifying the connection 
weights in response to a desired output presented to the 
network corresponding to a given input. In this thesis, the 
generalized delta learning rule was selected to reduce the 
error between the actual and desired output of a processing 
element. 

If the network is not given any desired output, an 
unsupervised learning process applies. The network forms 
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groups of similar input patterns, where each processing 
element responds strongly to different groups. 

Self-supervised learning falls between the supervised 
and the unsupervised learning. The network will determine its 
own desired solution and trains itself accordingly. 

4 . Recall rule 

Recall is a simple feedforward network where no 
learning takes place, i.e., no feedback between layers. An 
input is presented to the network, the information is 
propagated forward through the different layers, and an output 
is obtained. It is a straightforward process, where only the 
summation operation and the transfer function apply. It is an 
integral part of the testing process which compares the 
desired and the actual output of the network to determine the 
current error. 

C. BACK-PROPAGATION ALGORITHM 

The supervised learning rule and the back-propagation 
algorithm were chosen for the networks of this investigation. 
Back-propagation has a particular way of handling errors. It 
distributes the error by propagating the output error backward 
through the connections of the previous layers. 

When the signal is fedforward from the input to the 
output, the error between the desired and actual output is 
obtained. This error is, then, multiplied by the derivative of 
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the transfer function, and backpropagated from the input to 
the output layer to adjust or update the connections' weight. 

The typical neural network using the back-propagation 
algorithm is best represented with an input layer, an output 
layer, and at least one hidden layer using a monotonic 
activation function. [Ref. 4:pp. NC112] 

For a better understanding of the next sections, a clear 
notation is necessary. The superscript in brackets symbolizes 
the layer being considered, 

Xj[s] : current output state of jth neuron in layer s, 
Wj i [s]: weight on connection joining ith neuron in layer 
s-1 to jth neuron in layer s, 

Ij [s] : weighted summation of inputs to jth neuron in 
layer s. 

1. The Global Error Function 

The learning process has the aim of minimizing the 
global error, E, by adjusting the weights in the network. 
Therefore, the measure of the global error, E, is achieved by 
subtracting the desired output d by the actual output o, as 
follows : 

E = 0 .5*Z( (dj-Oj) 2 ) (2.5) 

where the term in parentheses is the raw local error. The 
global error function, E, is also a differentiable function of 
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all connection weights in the network. The derivative of E 
with respect to I gives, 

e^ s} = - dE/dlj [s] (2.6) 

The raw local error of equation (2.5) is scaled by multiplying 
it by the derivative of the transfer function, or 

e 7 - = -dE/dljl*! (2.7) 

= - (dE/dOj) * (doj/dlj) 

= (d j -Oj)*f (Jj) 

The scaled local error, which is backpropagated, will be 
stored in each processing element in its error field. 

A gradient descent rule is used to determine if an 
increment or decrement of the current weights, > is 

favorable to reduce the global error. The result by using the 
chain rule and equation (2.6) is, 



dE/dWj±t s l = (dE/dl^s] ) * (dl^s] /dWjj-ls] ) (2.8) 

The gradient descent rule used is, 

= -lcoef*(dE/dWj 1 ( s J) (2.9) 
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where lcoef is the learning coefficient or rate. 

Combining equations (2.8) and (2.9) gives, 

Aw = lcoef *eJ s l *x jL t s ~ 1 ] (2.10) 

The error signal, , of the above equation is applied only 

to the elements of the output layer. 

As to the elements of the hidden layers which do not 
have any desired output, is expressed as the derivative 

of the transfer function multiplied by the error and the 
weights backpropagated from the previous layer, or 

e/ s] = f' (I j lsl )*Z k (e k ls + 1] *w kj [ s + 1 ) ) (2.11) 

2. Back-propagation Summary 

The input layer will be presented with some data which 
the network will propagate in a straightforward sense 
(feedforward) to the output layer. At the same time, all the 
summed inputs, Ij[s], and output states, x-[s], will be set 
for each processing element. 

For the output layer, the scaled local error from 
equation (2.7) and the delta weight of equation (2.10) will be 
calculated for each of its processing elements. 

For the hidden layers, the scaled local error will be 
calculated using equation (2.11) and the delta weight using 
also equation (2.10). 
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An update of all the weights will be performed by 
adding these delta weights to their corresponding previous 
weights. [Ref. 4:pp. NC116] 
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III. 



ADAPTIVE CONTROL SYSTEMS 



An adaptive controller is one in which the control system 
has the ability to adjust itself in order to compensate for 
some changes in the system's parameters and environment. 
Adaptive control is divided into two functions: a control 
function and a model estimation function. 

The design of an adaptive control system can be 
conceptually simple when combining a particular parameter 
estimation technique with any control law. 

In this chapter, two traditional adaptive control methods 
will be briefly discussed, a one step ahead control algorithm 
will be used to design the control model, and a linear least 
square estimation will be implemented with a recursive least- 
squares algorithm to produce a predictor-corrector equation 
used to design the estimator model. 

A. TWO TRADITIONAL ADAPTIVE CONTROL METHODS 

There are two traditional adaptive control methods that 
are of interest to neural network control theory: the self- 
tuning regulator of Astrom (STR) and the Lyapunov model 
reference adaptive control (MRAC) . The self-tuning regulator 
block diagram is shown in Fig. 7. It is a classical feedback 
system with on-line adjustable coefficients. [Ref. 5] 
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Figure 7 Self-Tuning Regulator Control Block Diagram 

For the approximation of the model that describes the 
system being controlled, a least squares error parameter 
identification technique is used. The regulator parameters are 
adjusted during each control cycle according to the best 
estimate of the system parameters. 

With this method, the stability of the system is not 
always guaranteed. During the learning phase the input signal 
can become infinitely large, thus the model is not realizable. 
If the least-squares error parameter estimates do not match 
entirely the description of the system, the closed-loop system 
performance will not satisfy the design specifications. 

The second adaptive control method is the Lyaponuv model 
reference adaptive control (MRAC) , shown in Fig. 8. The system 
is forced to follow a reference model. [Ref. 5] 
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The regulator consists of two loops, an inner and an outer 
loop. The inner loop is a feedback loop composed of the 
regulator and the plant. 




Figure 8 Model Reference Adaptive Control Block Diagram 

The outer loop is also a regulator loop. It adjusts the 
parameters of the regulator by minimizing the error between 
the plant output y and the model output y m . Therefore, the aim 
is to determine the adjustment mechanism so that the system 
being controlled tracks perfectly the reference model with 
zero error. 

The latter type of adaptive controller will be emphasized 
in this thesis. 
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B. ONE STEP AHEAD PREDICTION CONTROL 



The first function of adaptive control is control. The 
one-step-ahead controller is a very simple form of a control 
law. The basic idea is that the control input at each point in 
time is determined so as to bring the output, y(t+d) (where d 
represents a time delay), to a desired output value, y*(t+d), 
in one step. This controller works not only for linear systems 
but also for a large class of nonlinear systems [Ref. 6:pp. 
118-122] . 

The input-output properties of the system can be described 
by three equivalent model formats: a left difference operator 
representation, an observable state-space model, or a DARMA 
(discrete time deterministic autoregressive moving average) 
model [Ref. 6:p. 120]. The simplest to use for the development 
of adaptive control algorithms is the (DARMA) model. That 
model can be expressed as, 

A(q)y(t) = B(q)u(t) where (3.1) 
Afq- 1 ) = I+A 1 (q) + . . .+A n (q) ■ 

B (q -1 ) = B q +. . .+B m (q) 

where A(q) and B(q) are matrix polynomials expressed in terms 
of the backward shift operator, q~ 1 , the system output, y(t), 
and the system input, u(t). The terms in the past values of y 
are the autoregressive components and the terms in the past 
values of u are the moving-average components. A DARMA model 
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can be compared to a controllable and observable state-space 
model with an arbitrary initial state, or simply a transfer 
function. [Ref. 6:p. 32] 

Rearranging equation (3.1) by expanding a single input 
single output (SISO) DARMA model in the shift operator gives, 

y(tj - b : u (t-1) +b 2 u (t-2) + . . .-a : y (t-1) -a 2 y (t-2) . . . (3.2) 

which can be used to predict the output at the next time step, 

y* (t+1) = bjU (t) +b 2 u (t-1) + . . .-ajy (t) -a 2 y (t-1) . . . (3.3) 

where y* (t+1) is the predicted value of y(t+l). The control 
input, u(t), of equation (3.3), which brings the system to a 
desired value y* (t+1) in one step, can be solved as follows: 

u(t) = 1/bj [y* (t+l)+a 1 y(t)+a 2 y(t-l) + . . . 

-b 2 u (t-1) . . . ; (3.4) 

where the term y* (t+1) could be some reference input to the 
system [Ref. l:p. 19]. 

The one step ahead prediction control law equation (3.4) 
minimizes the quadratic cost function comprising the squared 
prediction error: 



J(t) = 1/2 [y(t+l)-y* (t+1) ] 2 (3.5) 
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Excessive effort may be required to bring y(t+l) to 
y* (t+1) in one step. Therefore, some generalized cost 
functions of the same form like the weighted one-step-ahead 
controller [Ref. 6:p. 122], described below, could achieve a 
compromise between the level of effort expended and the 
prediction error. 

If the past values of y(t) and u(t) are state variables, 
the one step ahead controller becomes, 

u(t) = K(t)x(t)+r(t) (3.6) 

which is a state variable feedback with r(t) as the reference 
input controller. From equation (3.4), the vector of past 
outputs and inputs provides the state variables in equation 
(3.6) which in turn provides a controller for an adaptive 
algorithm [Ref. 6:pp. 120-170], This one step ahead controller 
could easily be modified to represent a weighted 
sum of state variables and a reference input, i.e., a weighted 
one-step-ahead controller, 

u(t) = Xj W^+Njft) (3.7) 

where Nj(t)=[ r(t) u(t-l) u (t-2 ) . . . -y (t) -y(t-l) -y(t-2)...] 
As mentioned in the chapter of neural network theory, the 
input to a processing element is defined as the weighted sum 
of all the element activations coming to its input, as shown 
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in Fig. 2. Therefore, a direct comparison could be made 
between the two previous statements, in that this form of 
controller may well be represented by neural network 
processing elements. 

C. LINEAR LEAST SQUARE ESTIMATION 

The second function of adaptive control is estimation. On- 
line estimation techniques provide estimates for the system 
parameters based on minimizing the quadratic cost functions as 
in the case of a one-step-ahead controller. 

The input-output characteristics of many linear and 
nonlinear deterministic systems may be described by the 
following model [Ref. 6:p. 50]: 

y(t) = N(t-1)6 T (3.8) 

where y(t) denotes the system output 

N(t-l) denotes a regression vector containing past 
measurements of the input and output, 

6 denotes a parameter vector. 

A first order DARMA model can be represented by [Ref. 6:p. 
50], 

y(t) = E b jU (t-j)~ Z a k y (t-k) (3.9) 
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where j and k are indices for past input and output 
measurements. Equation (3.9) can be expressed in the form of 
equation (3.8) as follows: 

N(t-l) = [u(t) u(t-l) u ( t-2 ) . . .-y(t-l) -y (t-2) . . .] (3.10) 

8 = [b 1 b 2 b 3 . . .a 1 a 2 a 3 ] (3.11) 

With equation (3.9) the prediction error becomes, 

e(t,8) = y(t)-N(t-l)8 T (3.12) 

where e is used in the quadratic cost function to determine 
some optimal value for 8 [Ref. 7:pp. 176-179], 

J(8) = 1/2 * t [e] 2 (3.13) 

where t covers 1 to n measurements. Equation (3.13) can be 
minimized analytically by differentiating with respect to 6 
and setting the result equal to zero, which on solving for 8 
gives the linear least square estimate , 

© = [1/n Z t N (t)N T (t) J -1 l/n Z t N(t)y(t) (3.14) 

where 0 is the estimated parameter vector, equation (3.11). 
The recursive least-squares algorithm [Ref. 7:p. 307] 
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summarizes in five equations the way of determining the 
parameter vector, 6, 

Q(t+1) = 9(t)+L(t) [y(t)-Q T (t)N(t-l) ] (3.15) 

L(t) = P(t-1)N (t-1) [1+N T (t-l)P(t-l)N (t-1) J' 1 
P(t) = P(t-l)-[A(P,N,t) /B(P,N,t) ] 

A ( P, N , t) = P (t-1 ) N t ( t-1) N (t-1) P (t-1) 

B(P,N,t) = 1 + [N T (t-l)P(t-l)N (t-1) ] 

The first equation of (3.15) is a predictor-corrector 
equation, while the others solve for the estimation gain, 
L(t) . 

A special form of a predictor-corrector equation that is 
used in many least-squares parameter estimation applications 
is expressed as follows: [Ref. 6:p. 49] 

6(t+l) = d(t)+M(t)N(t-l)e(t) (3.16) 

where G(t) denotes the parameter estimate at time t 

M(t) denotes an algorithm gain (possibly a matrix) 
N (t-1) denotes the regression vector 
eft) denotes the model prediction error 
The gain term, M(t), may vary from a scalar constant to a 
covariance matrix, as seen in equation (3.15) with L(t). 
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From the back-propagation learning rule discussed in the 
previous chapter, equation (2.10) is very similar to the 
linear least squares parameter estimator, equation (3.16), 

AwjJ s ^ = lcoef*e J ^ s ^*x i ^ s ~ 1 ^ (2.10) 

The learning coefficient, lcoef , is equivalent to the 
algorithm gain, M(t); the error signal, ej, is equivalent to 
the model prediction error, e(t); and the activation value, 
x±, is equivalent to the regression vector, N(t-l). Thus, a 
neural network using the back-propagation algorithm is in a 
sense a linear least squares estimator [Ref. 7:p. 22]. The 
algorithms and theorems applicable to the linear least squares 
estimation should, for the most part, be applicable to the 
back-propagation neural network. 

In summary, adaptive control is a combination of a control 
method and a model estimation. For the control method, the 
Model Reference Adaptive Control (MRAC) was chosen over the 
Self-Tuning Regulator (STR) . As to the controller itself, the 
weighted one step ahead prediction controller was defined as 
the weighted sum of the state variables and the reference 
input. These weights or feedback gains are extracted from the 
adjustment mechanism of MRAC in Fig. 8 and are determined by 
minimizing the error between the network predicted output and 
the model output. 
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For the estimation model, which is the linear least 
squares estimate, the predicted output was also defined as 
some weighted sum of the terms in the regression vector. This 
time, the weights are determined using the predictor-corrector 
equation to minimize the error between the measured and 
predicted output. 

By combining the control and estimation models above, it 
appears that the back propagation learning rule could produce 
models for adaptive control problems. 
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IV. X-29 MODERN AIRCRAFT 

The purpose of this chapter is to present a description of 
the modern aircraft chosen and to describe the H 2 and H m 
controllers that were previously designed to solve the 
instability of that aircraft. The model used is the subsonic 
longitudinal dynamics of the X-29 fighter aircraft. The X-29 
is a single seat forward swept wing (FSW) demonstrator 
aircraft built by the Grumman Corp. The FSW design offers a 
new generation of tactical aircraft that is smaller, lighter 
in weight, less costly, and highly efficient. 

A. FIGHTER DESCRIPTION 

The aerodynamic advantages of a forward swept wing have 
been known since the 1940's. These advantages are: improved 
maneuverability with spin-proof characteristics, better low- 
speed handling, and reduced stalling speed. Another important 
advantage is the low drag across the entire operational 
envelope, particularly around the sonic speed, which permits 
the use of a less powerful engine [Ref. 8], The FSW design is 
expected to reduce the transonic drag about 20%, and to 
handle low speeds and high angles of attack much better than 
any aft-swept wing [Ref. 8:pp. 47]. However, no suitable 
structure could be found in the 1940's to take full advantage 
of these benefits. Only years later, did the use of advanced 
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composite materials offer a solution. The graphite composite 
material, strong and light in weight, was utilized on the FSW 
to eliminate the adverse static aeroelastic coupling between 
wing bending and torsion. The X-29, shown in Figure 9, 
features close-coupled canard surfaces in front of the 
forward-swept wings for primary pitch control. [Ref. 9] 




Figure 9 Grumman X-29 FSW Demonstrator Aircraft 



The small strake flaps at the rear of the aircraft provide 
additional pitch at low speed. 

To optimize the wing for various flight conditions, the 
wing's two segment trailing edges (flaperons) behave as a 
variable camber device for pitch control. This variable camber 
control will permit the airplane to be optimized for low 
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speed, maneuvering, cruising, and high-speed flight 
conditions . 

The X-29 longitudinal dynamics model considered in this 
thesis is the analog reversion mode with the aircraft trimmed 
at 0.5 mach, 30,000 feet. The original 83rd order model was 
reduced to a 14 state model. The reduced model includes a 
short period approximation of the aircraft longitudinal 
dynamics, the vertical velocity, w, and pitch rate, g, and the 
fourth order actuator dynamics for the three longitudinal 
control surfaces, i.e., the canards, flaperons and strakes. 

Figure 10 shows the open loop actuator/aircraft dynamics 
model of the X-29 [Ref. 2). The two separated commands, and 
r 2 , are the input to the three control surface actuators with 
controlling the canards and r 2 controlling the flaps and 
strakes. The outputs of the system are the two states, w and 
g. The w-state becomes the angle of attack a when divided by 
the initial forward velocity U Q . Therefore, the uncompensated 
model has two inputs, two outputs, and 14 states. The control 
inputs to the aircraft dynamics are the canards S c , the 
flaperons 6 fl the strakes <5 S and their respective first and 
second derivatives. 

The uncompensated state variables are listed in Table I, 
and the open loop poles are listed in Table II. Notice the 
positive pole, 1.9550, on the real axis, meaning that the X-29 
has an unstable short period mode. [Ref . 2] 
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A 




Figure 10 Uncompensated X-29 Open-Loop Plant 
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TABLE I 


: UNCOMPENSATED X-29 


MODEL STATES 


State 


Description 


Units 


a 


angle-of-attack 


rad 


q 


pitch pate 


rad/sec 




canard control input 


rad 


5 f 


flap control input 


rad 




strake control input 


rad 




-canard control rate 


rad/sec 


*, 


flap control rate 


rad/ sec 




strake control rate 


rad/sec 




canard control accel. 


rad/sec 2 


h 


flap control accel. 


rad/ sec 2 




strake control accel. 


rad/sec 2 




canard control jerk 


le+04 rad/sec 3 




flap control jerk 


le+04 rad/sec 3 




strake control jerk 


le+04 rad/sec 3 


TABLE II 


: UNCOMPENSATED X-29 


OPEN-LOOP POLES 



-2.2746e+02 ± 2.3201e+02i 
-1.4491e+02 
-1 . 4455e+02 
1. 9550e+00 
-1 . 003 le+02 
-2 . 7 155e+00 

-5 . 2506e+01 ± 4.8410e+01i 
-5 . 2518e+01 ± 4.8255e+01i 
-5 . 0067e+01 
-2 . 0172e+01 
-2 . 0115e+01 
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b. h 2 and h*, controllers 

The uncompensated X-29 model possesses poor disturbance 
attenuation, high sensitivity to plant variations and modeling 
errors, and a small control bandwidth. 

Three weighing functions were utilized in Ref. 2 to 
improve these performance characterizations by suppressing the 
sensitivity function singular values as much as possible, 
i.e., to make the loop gains as large as possible over a wider 
bandwidth. The resultant X-29 augmented plant is a 16th order 
system, in which the weighing functions added two states. 

The two Riccati solution methods mentioned in Ref. 2 
indicate that H 2 and controllers must be the same size as 
the augmented plant. Therefore, the X-29 controller has to be 
of 16th order. As a result, the H ro compensated X-29 has a 
larger disturbance attenuation, lower sensitivity to 
variations and modelling errors, and a wider control 
bandwidth. [Ref. 2] 

Two H^, and H 2 controllers have been designed to represent 
the optimal-performance and the limited- performance models. 

The closed-loop architecture for the compensated X-29 
is shown in Fig. 11. The first block is the 16th order 
controller and the second block the 14th order plant matrix. 
[Ref. 2 : p . 62] 
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Closed-Loop Architecture 
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Plant 
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Controller 






— 


A 













Figure 11 Closed-Loop Model of the Compensated X-29 

Unlike the open loop actuator/aircraft dynamics model of 
Fig. 10, the command vector r, composed of elements and r 2 , 

represents the reference commands for the controlled outputs, 
a and q. The controllers have been placed in series with 
the fighter plant to be fed backward with a negative gain of 
one. Therefore, the closed-loop system has two inputs, two 
outputs and thirty states. 

The longitudinal equations of motion may be expressed in 
the following state variable form: 

x(t) = Ax ( t) + Bu(t) (5.1) 

y(t) = Cx(t) + Du (t) 

where x(t) contains the state variables of the 
controller and of the X-29 plant, 



33 



u(t) 



contains the input variables (t) and 
r 2 (t ) , and 

y_(t) contains the output variables aft) and 
q(t) . 

1. Optimal-Performance Model (Compensated) 

The Matlab program used to obtain the closed-loop 
state space representation of the H m optimal-performance model 
is described in Ref. 2 pages 115 to 121. 

The poles of the closed-loop model are listed in 
Table III. The unstable short period pole, 1.9550, of the 
open-loop system in Table II is mirrored into the left half 
plane in Table III. 

Safonov [Ref. 11] indicates that this mirror imaging 
does not cause any limitation to the system's performance if 
this pole is not the dominant one. 

The compensated X-29 model provides precision flight 
path control modes due to the multiple, independently 
controlled surface configuration. Figure 12 shows a graphic 
representation of these precision control modes, 

where a denotes angle-of-attack, 

0 denotes pitch attitude, 

Y denotes flight path angle, 
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TABLE III : X-29 OPTIMAL PERFORMANCE CLOSED-LOOP POLES 



4 . 1327e+02 
2 . 2745e+02 
1 . 3068e+02 
5 . 3305e+01 
1 . 4491e+02 
1.44 52e+02 
1 . 3014e+02 
1 . 3877e+01 ± 
9 . 9794e+01 
5 . 2545e+01 ± 
5 . 2503e+01 ± 
7 . 4 132e+01 
1 . 9550e+00 
2 . 7 155e+00 
2 . 0379e+01 ± 
2 . 0578e+01 ± 
4 . 9199e+01 ± 
4 . 24 65e+01 
2 . 0184e+01 
2 . 0110e+01 



± 2 . 3201e+02i 
± 4 . 6111e+0li 
± 8.9700e+01i 



5 . 9243e+01i 

4 . 8359e+01i 
4 . 8301e+01i 



2 . 1564e+01i 
1. 8907e+01i 
6 . 53 16e+00i 



Xp and s denote the aircraft principal and 
stability axes. 



The three precision longitudinal modes observed are [Ref. 12]: 

1. Vertical Translation: The aircraft's vertical velocity is 
controlled at a constant 6 by varying a ,i.e., the 
aircraft's flight path angle, y, or velocity vector, is 
controlled while Xs remains fixed. 

2. Direct Lift Control: The aircraft's flight path angle, y , 
is controlled at a constant a by varying 6, i.e., the 
aircraft's flight path angle, y, or velocity vector, 
remains along the aircraft's axis Xp as Xs rotates. 

3. Pitch Pointing: The aircraft pitch attitude, 6, is 
controlled at a constant flight path angle, y, i.e., the 
aircraft's flight path angle, y, or velocity vector 
remains fixed while Xs rotates (0= a) . 
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Reference Condition 




Vertical Translation 




Direct Lift Control 




Pitch Pointing 

Figure 12 Precision Control Modes 
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a. 



Time Domain 



The longitudinal motion of the X-29 is described 
in time and frequency domains. For the time domain, a pulse 
input of one degree was applied for one second to each of the 
two reference commands. The a(t) and q(t) time responses of 
the compensated X-29 for input 1, ri , and for input 2, r 2 , are 
shown in Fig. 13 and 14. 

The vertical translation mode is represented by 
Fig. 13 in which input 1 separates g and 6 from a. It follows, 
that there are negligible changes in q (order of magnitude 10“ 
- 1 ) compared to a, which has a fast response of 0.180 sec. 

The direct lift control mode is represented by 
Fig. 14, in which this time input 2 separates a from g. The X- 
29 responds to input 2 with a negligible a (order of magnitude 
10" 1 ) and with a positive g rise time of 0.180 sec. 
b. Frequency Domain 

The continuous and discrete Bode frequency 
responses of a(t) and q(t) for input 1, rl , and for input 2, 
r2 , are shown in Fig. 15 through 18. 

The discrete frequency responses are dominated by 
short period modes. For convenience, the high frequency 
dynamics above the nyquist frequency have been removed for the 
subsequent Bode plots. 
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Figure 13 Q and a Time Responses to Input 1 (Optimal case) 




Figure 14 Q and a Time Responses to Input 2 (Optimal case) 
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magnitude 




Figure 15 Continuous and Discrete a Frequency Responses 
to Input 1 (Optimal case) 



io° c 




Figure 16 Continuous and Discrete q Frequency Responses 
to Input 1 (Optimal case) 
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Altitude = 30000 feet frequency (Hz) Mach =.5 

Figure 17 Continuous and Discrete a Frequency Responses 
to Input 2 (Optimal case) 




Figure 18 Continuous and Discrete q Frequency Responses 
to Input 2 (Optimal case) 
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2 . Limited-Performance Model 

The limited-performance X-29 can be characterized by a 
smaller control and closed loop bandwidth, a larger 
sensitivity to plant variations and modeling errors, and a 
smaller disturbance attenuation [Ref. 2:p. 87]. 

The Matlab program used to obtain the closed loop state 
space representation of the H^, limited-performance model is 
described in Ref. 2 pages 115 to 121. The closed loop poles 
are listed in Table IV. Notice that the same unstable short 
period pole, 1.9550, of the open loop system is mirrored into 
the left half plane. 



TABLE IV : X-29 LIMITED PERFORMANCE CLOSED-LOOP POLES 



-2 . 2747e+02 ± 
-1. 3612e+02 
-1 . 4415e+02 
-1 . 4494e+02 
-1. 4476e+02 
-1 . 0023e+02 
-5 . 1688e+01 ± 
-7 . 2 3 13e+01 
-3 . 7606e+01 ± 
-5 . 1716e+01 ± 
-5 . 3298e+01 ± 
-5 . 2512e+01 ± 
-5 . 0505e+01 
-3 . 6342e+01 
-1.1889e+01 ± 
-1. 9539e+00 
-2 . 7204e+00 
-3 . 7372e+00 
-9 . 6752e+00 
-2 . 03 87e+01 ± 
-2 . 1180e+01 



2 . 3201e+02i 



7 . 7445e+01i 

5 . 2777e+01i 
5. 0560e+0li 
4 . 7220e+01i 
4 . 8306e+0li 



1. 2160e+01i 



1. 1180e+00i 
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a. Time Domain 



As in the optimal performance case, a step input of 
one degree for one second was applied to each of the two 
reference commands. 

The a ft) and q(t) time responses of the limited- 
performance X-29 for input 1, r lt and for input 2, r 2 , are in 
Fig. 19 and 20. The separation of a and q responses in both 
inputs are not as pronounced as in the compensated X-29 case. 
The step inputs with rise times of 0.5 sec and 0.8 sec to 
input 2 indicate that the limited-performance model was slower 
to react ,i.e., it is the result of a smaller closed loop 
bandwidth [Ref. 2:p. 93]. 

Therefore, the precision flight path modes in the 
case of the limited-performance X-29 are not as fully 
accomplished as the optimal-performance case. 

b. Frequency Domain 

The continuous and Bode frequency responses of aft) 
and q(t) for input 1 and 2 are shown in Fig. 21 through 24. As 
in the optimal performance model, the high frequency range was 
limited to 50 hertz. 
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Figure 19 Q and a Time Responses to Input 1 (Limited case) 




Figure 20 Q and a Time Responses to Input 2 (Limited case) 
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Altitude = 30000 feet frequency (Hz) Mach =.5 

Figure 21 Continuous and Discrete a Frequency Responses 
to Input 1 (Limited case) 




Figure 22 Continuous and Discrete q Frequency Responses 
to Input 1 (Limited case) 
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Figure 23 Continuous and Discrete a Frequency Responses 
to Input 2 (Limited case) 




Figure 24 Continuous and Discrete q Frequency Responses 
to Input 2 (Limited case) 
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V 



EXPERIMENTAL SET-UP 



In this chapter, a description of the hardware and 
software used for the experimental set-up of the neural 
network adaptive control will be given. Model design 
considerations will follow which include design objectives, 
model structure selections, and choices of configurations. 
These configurations will be demonstrated with eight cases 
which are the framework of the experiments in the use of 
neural networks in adaptive control. 

A. HARDWARE AND SOFTWARE REQUIRED 
1. Hardware 

All the research done in the area of data processing 
was conducted on the SPARC® Station 2. To emulate a parallel 
distributed processor which requires a very large memory 
capacity and high speed, the choice of this station becomes 
apparent. The SPARC® Station 2 uses a 32-bit architecture with 
a 40 mHz central processing unit, Sun 4/75 CPU, and a memory 
card with 48 mBytes of RAM. An internal hard disk drive of 207 
mBytes and an external one of 996 mBytes were added to the 
system. 

The workstation provides a multitasking windowed 
graphical environment, which greatly enhances the system's 
flexibility in addition to the powerful UNIX operation system, 
Sun OS 4.1.1. 
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A 16-inch high resolution color monitor, a 0.25-inch 
cartridge tape drive, and a 3.5-inch high density diskette 
drive are also part of the system. 

Overall, the station's power and flexibility prove to 
be as important as its memory size and speed [Ref. 12]. 

2. Software 

The Neuralworks Professional II/PLUS package by 
Neuralware, Inc was the neural networks software used. 
Neuralworks requires a minimum of 400 kBytes of base memory to 
operate, and offers over a dozen different types of networks, 
from the historical perception and the brain-state-in-a-box, 
to the back-propagation and the Boltzmann machines. 

Neuralworks has a user's guide, some tutorials, a 
quick reference index, a menu listing, and many features of 
file inputs and outputs. It supports a general file format for 
inputting or outputting data to or from the network from 
standard spreadsheet file formats such as Lotus 1-2-3 and 
Excel, from the keyboard interface if formatted in ASCII 
files, or from user defined modules written in the C 
programming language. [Ref. 4:pp. UG215-UG250] 

Neuralprobe instruments are available which provide 
the ability to perform internal network diagnostics by 
allowing specify information to be extracted from a selected 
probe, and by presenting that information in a graphical form 
for weights, error values, or activation levels. 
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As mentioned earlier, the capability of accessing the 
data internal to Neuralworks or presenting information to the 
network, is made possible through the use of a user defined 
module, USERIO. This method of access incorporates a user 
written procedure (SimoMonika. c) to the network, as shown in 
Appendix C. 

The communication between Neuralworks and USERIO is 
through a series of data pointers which are described in the 
introductory pages of Appendix A. 

Neuralworks uses user-defined control strategies to 
supervise the input-output sequencing, the learning, and how 
and when the information is passed through the layers of the 
network. Neuralworks provides also default control strategies 
for standard networks. The strategies are written in assembly 
like language and are automatically loaded into memory when 
the networks are loaded. The two control strategies used in 
this research are shown in Appendix D. Both strategies will 
be described in more detail in the following section. 

The Matlab program with its signal processing and 
robust-control tool boxes was used intensively during the 
research. Written in C, Matlab provides a high-performance 
interactive software package for scientific and engineering 
computation [Ref. 13]. Matlab was employed mainly to perform 
time and Bode frequency response analysis by comparing the 
system and the actual neural network responses. 
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In summary, the SPARC Station 2, Neuralworks 
Professional II/PLUS, and the Pro-Matlab programs provided the 
necessary tools to successfully investigate the neural network 
adaptive control algorithm applied to the longitudinal 
dynamics of the X-29. 

B. MODEL DESIGN CONSIDERATION 
1. Design Objectives 

In any implementation of a neural network adaptive 
controller, the design objectives of the system, the 
controller and the estimator, must be made clear. 

The system must be controllable and observable in 
order for the controller and the estimator to be realizable. 
The Optimal and Limited performance cases fulfill both 
conditions . 

The controller has to be able to track some sort of 
model reference or predicted output. Stability is also an 
important aspect of a controller. The poles of the transfer 
function have to be well within the unit circle for stability. 
Zeros that are outside the unit circle are non-minimum phase 
zeros. When the transfer function is inverted, these non- 
minimum phase zeros become unstable poles. The unstable 
inverse transfer function requires complex control devices for 
exact tracking [Ref. l:pp. 32-49]. The neural network adaptive 
controller handles the non-exact tracking by determining the 
control gains in some least square sense. 
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The back-propagation learning rule performs this task with the 
connections' weights. 

The estimator has to model the input-output 
relationships of the system. The selection of proper inputs is 
a complex issue involving the input spectrum, the sampling 
time, and the data record length. 

a. Input Spectrum 

All modes of the system must be excited, which is 
known as the concept of persistent excitation [Ref. 7:p. 72]. 
This concept can be best achieved by a proper selection of the 
input spectrum. The input spectrum must be selected in such a 
way that the output signal strength exceeds any expected 
noise. A high signal to noise ratio must be maintained to 
conserve most of the information content of the input signal. 

b. Aliasing and Sampling time 

Since sampling the data leads to information 
losses, it is important to select the proper sampling time. 
The information loss is best described in the frequency 
domain, where 

w s = 2/T denotes the sampling frequency where 
T is the sampling interval, and 

w N = w s /2 denotes the Nyquist frequency. 

The part of the signal spectrum that corresponds 
to frequencies higher than w N will be interpreted as a 
contribution from lower frequencies. This superposition is 
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known as "aliasing" . Thus, the lost of information concerning 
frequencies higher than the Nyquist frequency is due to 
sampling. The best antialiasing filter is to sample fast 
enough to eliminate the high-frequency noise contributions. 

Nevertheless, sampling too fast may cause loss of 
information in the low frequencies, while sampling too slow 
may cause loss of information in the high frequency modes. 

Another problem of sampling too fast is the energy 
distribution problem in the higher frequencies which receive 
more excitation. This phenomenon will be demonstrated in 
Chapter VII with different plots of Bode frequency responses. 

Figure 25 shows the resulting poles-zeros plot for 
the selected sampling time of 0.02 seconds. Notice that the 
poles and zeros are well distributed between z = 0.0 and z = 
1.0, which is adequate for this investigation. Various trials 
were conducted with different sampling times but no 
improvements to the value of 0.02 seconds were found. 
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Figure 25 Poles and Zeros of the X-29 Closed-Loop Plant 

c. Data Record Length 

The simulation used in the USERIO program could 
generate data indefinitely. Modelling errors in the simulation 
like aliasing, the presence of non-minimum phase zeros and 
unstable poles propagate at a rate proportional to the power 
of the absolute value of the system zeros [Ref. 5:p. 43]. To 
prevent the modelling errors from growing unboundedly, the 
simulation has to be reset every so many cycles. Resetting the 
simulation adds noise to the frequency spectrum, as will be 
demonstrated in the next chapter. 

For linear, stable systems, the data will be 
generated indefinitely since the errors will not grow 
unbounded. For linear, unstable systems, the data record 
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length will be determined by limiting the network outputs to 
specific values. Finally, for non-linear systems using an 
activation function like the hyperbolic tangent function, the 
network output values will be limited to + 1. 

2. Model Structure Selection 

The model structure is based on the neural network 
adaptive controller in which the estimation and control 
algorithms are represented. Before selecting the model, the 
number of input and output elements, the status (linearity or 
non-linearity) , and the order of the system have to be known. 
This will determine the size of the regression vector which 
defines the number of elements in each layer. Whenever 
simulating a nonlinear model, hidden layers are utilized with 
nonlinear transfer functions. 

The closed-loop system representing either the optimal 
or the limited-performance, is a 30th order linear system with 
two inputs and two outputs. Hence, the selected model 
structure could be a MIMO (multiple inputs - multiple outputs) 
or a SIMO (single input - multiple outputs) if -only one input 
is activated at one time when testing the network. The chosen 
network structure does not have any hidden layers since the 
system is linear. The network should possess a regression 
vector of 90 elements if represented by a SIMO model 
structure, or 120 elements if represented by a MIMO model 
structure (30 for each input and 30 for each output) . 
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Two basic neural network model structures were 



developed for this research. 

a. SIMO Neural Network Model Structure 

Both, optimal and limited, performances could be 
represented with SIMO model structures. Figure 26 shows the 
SIMO neural network structure used for the 30 states closed 
loop X-29 plant. The first layer, the feedback layer, 



SIMO Model Structure 
a(t) act) 




consists of 89 elements. The first 29 elements are the past 
input values del(t-2), del(t-3), . . .del (t-30 ) , where the delay 
is indicated in parentheses. The remaining 60 elements 
represent the delayed past output measurements, 30 for a(t) 
and 30 for q (t) . 
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The command layer, the second layer, is a 
replicate of the first layer with the exception of the 
reference input, r(t-l), which is needed for the control law. 

The control layer, the third layer, consists of a 
single element, del(t-l), the control input. The connections 
between the control input and the command layer elements are 
weighted with a fixed value of zero, since the command layer 
was intentionally included in the network only to represent 
the regression vector, i.e., no learning is taking place. For 
control law purposes, only the connection between the 
reference input, r(t-l), and the control input, del(t-l), is 
weighted with a fixed value of one. Therefore, r(t-l) equals 
del (t-1 ) . 

The last layer is the output layer. The output 
layer is fully connected with variable weights to the control 
and the feedback layers. 

Notice that this network has no hidden layers 
between the control and the output layers since all inputs are 
directly connected to the output layer. Nevertheless, the 
single element in the third layer becomes a hidden layer in 
itself, since it relays the outputs of layer two to layer 
four . 

The estimation process begins when the activation 
value of each output element is compared directly to its model 
predicted output, and the current error is back-propagated 
through the control and feedback layers by adjusting their weights. 
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b. MIMO Neural Network Model Structure 



Figure 27 shows a MIMO model structure used for 
the 30 state closed loop plant of the X-29. This time, two 
reference and control inputs were present, r 1 (t-l) , r 2 (t-l) , 
del 1 (t-l) and del 2 (t-l). As with the SIMO structure, r 1 (t-l ) 
and r 2 (t-l) equal del 1 (t-l) and del 2 (t-l). 



MIMO Model Structure 

a(t) q(t) 




Figure 27 MIMO Neural Network Model Structure 

As expected, the size of the regression vector has 
increased from 90 elements to 120, since the second input past 
measurements are added to the vector. 

3. Choices of Configurations 

In this thesis, three configurations are proposed for 
training neural networks to provide the appropriate inputs to 
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the X-29 plant in which desired responses are obtained. These 
three configurations are: the simulation of the closed-loop 
plant, the identification of the inverse plant, and the 
simulations of the existing controllers and the plant, 
a. Simulation of the Closed-Loop Plant 

In this first configuration, the neural network 
will emulate the closed-loop architecture of Fig. 28. The 
inputs, r x and r 2 , to the 30 states transfer function that 
comprises the controller and the plant in series and a 
negative feedback loop of gain one, will be the inputs to the 
neural network. The outputs of the 30 states transfer 
function, a and g, which represent the true system outputs, 
will be the desired outputs of the neural network. 



Closed-Loop Architecture 



Neural Network 
Level 1 




Figure 28 Closed-Loop Architecture 
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Each performance, the optimal and the limited, 
will be emulated using one MIMO model structure as shown in 
Fig. 27. 

In order to facilitate the integration of the 
configurations to the USERIO program, specific case numbers 
are associated with each configuration. That way all three 
configurations can use the same USERIO program, SimoMonika.c. 
Each case number is stated in a header file. A header file 
defines all the variables utilized in the USERIO program: the 
case number, the sampling time, the input conditions, the 
numerator and the denominator coefficients of the transfer 
functions. All the header files, or transfer. h files, used for 
this research are shown in Appendix C. The numerator and 
denominator coefficients were obtained using the MATLAB file 
of Appendix D. 

As to the control strategy, the first prototype, 
contstrl .nnc , described in Appendix B is employed when only 
one structure or network is needed to represent the 
configuration. The second control strategy, contstr2 .nnc, is 
employed when two networks are needed to represent the 
configuration. Therefore, the single MIMO network needed to 
simulate the closed-loop plant should be trained using the 
first control strategy, contstrl .nnc . 

Both control strategies use the back-propagation 
algorithm with the generalized delta learning rule which 
reduces the error between the actual and desired outputs of a 



sa 



processing element by modifying the incoming connection 
weights . 

The table in Appendix E shows the case number, the 
model structure, the control strategies, and the header files 
associated with each configuration. Notice that this first 
configuration contains two cases. Case #1 emulates the optimal 
performance model, and case #2 emulates the limited 
performance model. Also notice that the model structure has 
been divided into two levels. Level 1 and 2 represent the 
first and the second network to be trained. Both levels are 
usually connected in series and could be trained either one at 
a time or both simultaneously depending on the configuration 
chosen. In this configuration, only level 1 applies since only 
one network is necessary to represent each of the two cases. 

When training neural networks, the stability of 
the system being emulated is an important factor to be 
considered. Since the transfer functions of the optimal and 
the limited-performance models are stable and linear, there 
should be no requirements for resetting the networks. The 
error should not grow unbounded during the learning process, 
b. The Identification of the Inverse Plant 

Figure 29a demonstrates the second configuration 
where an adaptive architecture is presented to identify the 
inverse of a plant [Ref. 14]. 



59 



Inverse Plant Architecture 



Neural Network 
Level 1 




Neural Network 
Level 2 



B 




Figure 29 Inverse Plant Architecture 

The single input, u, to the plant will be the 
input to the network emulating the plant, and the outputs to 
the plant, a and g, which represent the true plant outputs, 
will be the desired network plant outputs. Then, the network 
plant outputs become inputs to the network emulating the 
inverse plant, and the input to the plant, u, becomes the 
desired network inverse plant output. Once the plant inverse 
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has been found, it can be used for control purposes as shown 
in Fig. 29b. The desired plant output, y'~y, is fed into the 
inverse plant, and the resulting output is used as input to 
the plant. As a result, the plant input produces the desired 
plant output. 

This control method can be applied to the control 
of linear and non-linear systems [Ref. 14:p. 34]. The 
configuration differs from the closed-loop architecture of 
Fig. 28 in that the input to the inverse plant is the desired 
plant output instead of the actual output, and that no 
feedback to the controller is required. 

In this second configuration, three cases will be 
investigated, as shown in Appendix E. The first case examines 
the large order transfer function of the 30 states closed-loop 
X-29 longitudinal plant whose inverse is stable. The second 
case will examine a simpler aircraft, the A-4D, which has a 
much smaller order transfer function, but whose inverse is 
unstable. The inverse longitudinal plant of the A-4D aircraft 
is unstable due to the fact that the plant has a non-minimum 
phase zero at -3.65 whose inverse becomes an unstable pole, as 
shown in Fig. 30. 
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Figure 30 Poles and Zeros of the A-4D Plant 



Finally, the third case examines the X-29 plant 
which is a larger order system than the A-4D and which has one 
unstable pole at +1.05 and three non-minimum phase zeros 
located at -4.5, +2.2 and +9.5, as shown in Fig. 31. As a 
consequence of the unstable pole, the X-29 plant is unstable, 
and as a consequence of the three non-minimum phase zeros, the 
inverse plant is also unstable. 
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Figure 31 Poles and Zeros of the X-29 Plant 

In all three cases, the model structure is 
composed of two levels: level 1 emulates the closed-loop plant 
for case #3 or the plant for cases #4 & 5, and level 2 

emulates their inverse. The two levels are connected in series 
and can be trained simultaneously. 

Figure 32 shows the inverse plant neural network 
structures developed for this investigation. As anticipated 
from Fig. 29, this configuration requires one SIMO neural 
network model structure to emulate the plant and one MISO 
neural network model structure to emulate the inverse plant. 
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Configuration # 2 : Identification of the Inverse Plant 



X-29 Inverse Plant 
u(t-l) ( MISO ) 




dell(t-2) - - -14 del2(t-2) - -14 ^ M) 



a(t) q(t) 



X-29 Plant 




Figure 32 Configuration #2 : Identification of the 

Inverse Plant 



64 





The input of the plant, u(t-l) , becomes the output 
of the inverse plant, and the output of the plant, a(t) and 
q(t) , becomes the input of the inverse plant. These two 
operations are performed in the USERIO program, and are 
demonstrated in the introductory pages of Appendix A. 

Since both systems, the X-29 plant and its 
inverse, are unstable, the neural networks will have to be 
reset many times to prevent the error from growing unbounded 
during learning. 

c. The Simulations of the Existing Controllers 
and the Plant 

Figure 33 shows the third configuration 
architecture. The inputs to the controller, dj and d 2 , which 
are the error between the reference inputs and the plant 

Open-Loop Architecture 



Neural Network Neural Network 

Level 1 Level 2 




Figure 33 Open-Loop Architecture 



63 



outputs, will be the inputs to the network emulating the 
controller. The outputs of the controller, iij and u 2 , will be 
the desired network controller outputs and the inputs to the 
network emulating the plant. The true plant outputs, a and g, 
become the desired network plant outputs. 

In Fig. 28 the entire closed-loop architecture is 
emulated, whereas in this configuration each controller and 
plant is simulated separately as an open-loop architecture. 
Each performance, the optimal and the limited, has its own 
controller but the same plant. 

As shown in Appendix E, the configuration has 
three cases. Case #6 & #7 emulate the optimal or the limited 
performance controller plus the plant, and case #8 makes the 
closure of the open-loop system of each case. The closure 
implies the connection in series of the controller and the 
plant, and the insertion of a negative feedback loop of gain 
one from the plant outputs to the controller inputs. 

Both controllers are emulated at level 1 and the 
plant is emulated at level 2, using HIMO model structures as 
shown in Fig. 34. In all three cases both levels can be 
trained simultaneously. 
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Configuration # 3 : Simulation of the Existing 

Controllers and the Plant 



o(t) ■> q<t) 



X-29 Plant 




X-29 Controller 

ul(t) u2(t) 




Figure 34 Configuration #3 : Simulation of the 
Existing Controllers and the Plant 
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Referring to Fig. 34, case #8 is represented by 
having the controller outputs, ul(t) and u2 (t ) , becoming the 
plant inputs, and the error between the plant outputs, a(t) 
and q(t), and the reference inputs, rl(t) and r2 (t ) , becoming 
the controller inputs, dl(t-l) and d2(t~l). These operations 
are performed in the USERIO program and are demonstrated in 
the introductory pages of Appendix E. 

The utility of this third configuration, knowing 

that effective controllers exist, is that: 

The adaptive network may be able to form an effective 
control rule on the basis of representation of the system 
state that is easier to measure than the representation 
required by the existing controller. (Ref. 7:p» 30] 
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VI. RESULTS AND DISCUSSION 



The experimental results of the eight configurations' 
cases described in Chapter V will be presented in this 
chapter. Time and frequency domain analyses of the neural 
network structures of each case will be performed to determine 
how close they are to the true system. All configurations 
except case #6 will use linear networks. Nonlinearity will be 
introduced in case #6, when two hidden layers are added with 
a hyperbolic tangent transfer function to the network 
emulating the optimal performance controller. 

To further investigate the nonlinear network models, an 
analysis using the singular value decomposition (SVD) will be 
carried out on the controller network of case #6. The optimal 
number of elements per hidden layer will be determined. 

A. CONFIGURATION #1: SIMULATION OF THE X-29 CLOSED- 

LOOP PLANT 

1. Case #1 - Optimal Performance X-29 Closed-Loop Plant 

The first case emulates the optimal performance X-29 
closed-loop plant. The neural network is trained using a 
single MIMO model structure fully connected with a linear 
activation function. Fully connected means that all the 
elements in the feedback and control layer are connected to 
all the elements in the output layer. After 20,000 cycles or 
300 seconds, the network has learned to respond correctly to 
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two random binary inputs of magnitude 1. The random binary 
swept square wave is an input signal which excites all the 
frequencies of interest. 

The frequency responses of the linear neural network 
and the frequency responses of the optimal-performance X-29 
model to two random binary inputs are displayed with discrete 
Bode plots in Fig. 35 through Fig. 38. The frequency responses 
of a(t) to input 1 and 2, which are shown in Fig. 35 and 37, 
develop near to exact model solutions. As expected, a small 
amount of unmodelled noise dynamics can be seen around the 
sampling frequency of 50 hertz. In Fig. 37, the network does 
not model exactly the low frequency region even after 20,000 
epochs. The frequency responses of q(t) to input 1 and 2, 
which are shown in Fig. 36 and 38, are very similar to the 
ones of aft;. The high frequency regions of both inputs and 
the low frequency region of input 2 are very well represented, 
whereas the low frequency region of input 1 shows a minor 
deviation from the true response, as shown in Fig. 36. 

To show how close the network outputs are to the true 
X-29 outputs, the RMS prediction error plots for a and q are 
given in Fig. 39 and 40. Notice that the vertical scales are 
on the order 10 -3 . As anticipated, the network has learned 
very well with RMS errors on the order of 0.00175 for a or 
0.175 percent of the maximum output value of one, and on the 
order of 0.003 for q. Further training did not improve the 
present results. 
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The performance of the neural network in the time 
domain was determined by applying a step of one degree for one 
second to each input, and by comparing the network's outputs 
to the true system, as shown in Fig. 41 through Fig. 44. As 
with the frequency domain, the network has learned to model 
the true system in the time domain. By comparing the magnitude 
of the time responses of Fig. 41 with Fig. 42 , it can be seen 
that the X-29 model and the network respond to input 1 with a 
positive a while the q response is negligible ( order of 
magnitude is 10 -1 ) . In Fig. 41, the network responds with the 
same a rise time of 0.180 seconds, and with the same magnitude 
of about 1.08 degree as the true model. In Fig. 42, the 
network q response is as fast with a rise time of 
approximately .095 seconds. The small oscillations produced by 
the neural network q response in Fig. 42 are negligible since 
the magnitude of the signal is very low. 

By comparing the magnitude of the time responses of 
Fig. 4 3 with Fig. 44, it can be seen that the responses of 
input 2 are the reversed responses of input 1, i.e., this 
time, the q response is positive while the a response is 
negligible with an order of magnitude 10 -1 . 
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Figure 35 X-29 Model and Network a Frequency Responses 
to Input 1 (Optimal case) 




Figure 36 X-29 Model and Network q Frequency responses 
to Input 1 (Optimal case) 
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Figure 37 X-29 Model and Network a Frequency Responses 
to Input 2 (Optimal case) 




Figure 38 X-29 Model and Network q Frequency responses 
to Input 2 (Optimal case) 
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Figure 41 X-29 Model and Network a Time Responses 
to Input 1 (Optimal case) 




Figure 42 X-29 Model and Network q Time Responses 
to Input 1 (Optimal case) 
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Figure 43 X-29 Model and Network a Time Responses 
to Input 2 (Optimal case) 




Figure 44 X-29 Model and Network q Time Responses 
to Input 2 (Optimal case) 
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2. Case #2 - Limited Performance X-29 Closed-Loop Plant 

This second case emulates the limited performance X-29 
closed-loop plant. The neural network is trained using also a 
single MIMO model structure fully connected with a linear 
activation function. The network has learned to respond 
correctly after 20,000 cycles or 300 seconds using two random 
binary inputs of magnitude 1. 

The frequency responses of the linear neural network 
and the frequency responses of the limited performance X-29 
model to two random binary inputs are displayed with discrete 
Bode plots in Fig. 45 through Fig. 48. The frequency responses 
of a(t) and q(t) to input 1 and 2, which are shown in Fig. 45 
through 48, develop near to exact model solutions. As with the 
optimal case #1, the frequency responses of a(t) to input 1 
and 2 show unmodelled noise dynamics around the sampling 
frequency of 50 hertz, as shown in Fig. 4 5 and 47. Further 
training did not improve the present results. Contrary to the 
optimal case #1, the network is better able to model the low 
frequencies of both inputs. 

RMS prediction error plots for a and g are given in 
Fig. 49 and 50. Notice that the vertical scales are on the 
order 10 -3 . As expected, the network has learned very well 
with RMS errors on the order of 0.001 for a or 0.1 percent of 
the maximum output value of one and on the order of 0.002 for 
< 7 - 
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The network has also learned to model correctly the 
limited performance X-29 closed-loop plant in the time domain. 
The X-29 model and the network time responses to input 1 and 
2 are given in Fig. 51 through Fig. 54. As with the optimal 
performance X-29 of case #1, the limited performance X-29 
model and the network responded to input 1 with a positive a 
and to input 2 with a semi-positive g, as shown in Fig. 51 and 
54. However, the decoupling of a and g is not as pronounced as 
in the optimal performance case, i.e., this time, the q(t) 
responses in Fig. 52 and the aft) responses in Fig. 53 are not 
negligible. 

The step responses of input 2 with an a rise time of 
0.8 second, in Fig. 53, and with a g rise time of 0.5 second, 
in Fig. 54, indicate that the limited performance X-29 model 
and the network are slower to react than the optimal 
performance case #1. In the optimal case #1, the rise time of 
a to input 2 was 0.180 second and the rise time of g to input 
2 was 0.095. The slower reaction times of the limited 
performance case is due to the fact that the control surface 
deflections and the control rates of the X-29 airplane were 
reduced to conform with the actuators limitations [Ref. 2], 

In summary, the first configuration could simulate 
case #1, the large order and stable optimal performance X-29 
closed-loop plant, and case #2, the large order and stable 
limited performance X-29 closed-loop plant, with high 
accuracy . 
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AJtitude= 30,000 feet frequency(hz) Mach= 0.5 



Figure 45 X-29 Model and Network a Frequency Responses 
to Input 1 (Limited case) 




Figure 46 X-29 Model and Network q Frequency responses 
to Input 1 (Limited case) 
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Figure 47 X-29 Model and Network a Frequency Responses 
to Input 2 (Limited case) 




Figure 48 X-29 Model and Network q Frequency responses 
to Input 2 (Limited case) 
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Figure 49 RMS Prediction Errors for a 
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Figure 50 RMS Prediction Errors for q 
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Figure 51 X-29 Model and Network a Time Responses 
to Input 1 (Limited case) 




Figure 52 X-29 Model and Network q Time Responses 
to Input 1 (Limited case) 
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Figure 53 X-29 Model and Network a Time Responses 
to Input 2 (Limited case) 




Figure 54 X-29 Model and Network q Time Responses 
to Input 2 (Limited case) 



83 



B. CONFIGURATION #2: IDENTIFICATION OF THE INVERSE PLANT 

The second configuration is divided into three cases. Each 
case contains two levels of model structure as shown in the 
inverse plant architecture of Fig. 29 in Chapter V. The neural 
network representation of the inverse plant architecture is 
illustrated in Fig. 32. The SIMO neural network structure of 
the first level in Fig. 32 simulates the transfer function or 
the plant, and the MISO neural network structure of the second 
level in Fig. 32 simulates the inverse transfer function or 
the inverse plant. Before attempting to test the inverse plant 
neural network structures of Fig. 32 with unstable systems 
like the A-4D or the X-29 inverse plant, the stable inverse 30 
states closed-loop transfer function of the optimal 
performance X-29 model will be examined first. Then, the 
testing of the small order, unstable inverse plant of the A-4D 
will follow and finally the unstable inverse plant of the X-29 
will be investigated. 

1. Case # 3 - Inverse Closed-Loop Plant of the Optimal 

Performance X-29 Model 

Since the transfer functions for a (t) and q(t) do not 
have any non-minimum phase zeros, the inverse 30 states 
closed-loop transfer functions of the optimal-performance case 
are stable. 

The two networks' structure of Fig. 32 have learned to 
model the inverse transfer function within 450,000 epochs or 
11,250 seconds. The SIMO network structure of Fig. 32 
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representing the 30 states closed-loop transfer function and 
the MISO network structure of Fig. 32 representing the inverse 
transfer function have been trained simultaneously. As with 
the first configuration, a random binary swept square wave of 
magnitude 1 was also the input signal at level 1. 

After the two networks of Fig. 32 are fully trained, 
the random binary step outputs of the inverse transfer 
function at level 2 (output 2) should be equal to the random 
binary step input of the transfer function at level 1 (input 

1) . A time history, based on the number of epochs, of the 
comparison between the input of the 30 states closed-loop 
transfer function and the output of the inverse transfer 
function to a random binary input signal is shown in Fig. 55 
through Fig. 62. The RMS errors between the two signals, 
output 2 and input 1, are also included in the list of 
f igures . 

As indicated in Fig. 55, after 2000 epochs or 500 
seconds, the output of the inverse transfer function (output 

2) is poorly correlated with the input of the transfer 
function (input 1) . The RMS error is approximately 1.00 or 100 
percent of the maximum output value of one, as shown in Fig. 
56. After 150,000 epochs or 3750 sec, output 2 shows some 
similarities with input 1, as indicated in Fig. 57. The 
network emulating the inverse transfer function at level 2 
learned to limit its output to values +1 and to follow the 
random binary step inputs of the transfer function at level 1 
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more closely. This time the RMS error, shown in Fig. 58, 
decreased from 1.0 to 0.35. After 250,000 epochs or 6250 sec, 
output 2 shows even better similarities with input 1, as 
demonstrated in Fig. 59. Only the magnitude of the steps need 
to be worked on. In this third trial, the RMS error in Fig. 60 
is on the order of 0.175. Finally in Fig. 61, after 450,000 
epochs or 11,250 sec, the output of the inverse transfer 
function (output 2) shows a near to exact solution to the 
input of the transfer function (input 1) . The lowest RMS error 
obtained is on the order of .008 or 0 . 8 percent of the maximum 
output value of one, as shown in Fig. 62. 

The discrete Bode plots in Fig. 63 and 64 give the a 
and q frequency responses to input 1 of the true optimal 
performance X-29 closed-loop transfer function and of network 
2, which emulates the inverse transfer function. The frequency 
responses of network 1, emulating the transfer function, were 
given in the optimal performance case #1. 

As explained in Appendix D, the Bode plots are 
obtained using the spectral transfer function. The spectral 
transfer function is calculated using an output vector and an 
input vector. When dealing with the neural network transfer 
function of level 1 in Fig. 32, the input vector is composed 
of the random binary step input signals at input 1 and the 
output vector is composed of the a and q time responses at 
output 1. However, when dealing with the neural network 
inverse transfer function of level 2 in Fig. 32, the input 
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vector is composed of the random binary step responses at 
output 2 and the output vector is composed of the a and q 
input signals at input 2. 

The frequency responses are well modelled across the 
spectrum with the exception of a minor deviation in the low 
frequency region of the network 2 q response in Fig. 64. 

In both time and frequency domain the SIMO and MIMO 
neural network structures of Fig. 32 have learned to model the 
inverse transfer function of a large order, stable system. 
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Figure 55 RB Input Comparisons after 2000 Epochs (case #3) 



RMS Error after 2000 epochs 




Figure 56 RMS Prediction Error after 2000 Epochs (case #3) 
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Figure 57 RB Input Comparisons after 150K Epochs (case #3) 



RMS Error after 150K epochs 




Figure 58 RMS Prediction Error after 150k Epochs (case #3) 
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RB Input comparison after 250K epochs 




RMS Error after 250K epochs 




Figure 60 RMS Prediction Error after 250k Epochs (case #3) 
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RB Input comparison after 450K epochs 
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Figure 61 RB Input Comparisons after 450K Epochs (case #3) 



RMS Error after 450K epochs 
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Figure 62 RMS Prediction Error after 450k Epochs (case #3) 
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Altitude = 30000 feet Frequency (Hz) Mach=.5 

Figure 63 X-29 Inverse Plant Model and Network 2 a 

Frequency Responses to Input 1 (Optimal case) 




Altitude = 30000 feet Frequency (Hz) Mach=.5 

Figure 64 X-29 Inverse Plant Model and Network 2 q 

Frequency Responses to Input 1 (Optimal case) 
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2. Case # 4 - Inverse Plant of the A-4D Aircraft 

The fourth case analyses an open-loop transfer 
function, the A-4D fourth order plant, instead of a closed- 
loop transfer function, the X-29 30th order system of case #3. 
As mentioned in the previous chapter, the A-4D plant is a 
small order system whose inverse is unstable due to the fact 
that the plant has a non-minimum phase zero. 

In this configuration, level 1 of the inverse plant 
architecture of Fig. 29 represents the A-4D plant and level 2 
represents its inverse. In Fig. 32, the same SIMO and MISO 
neural network structures of the X-29 case #3 were used for 
this case with the exception of three modifications. The first 
modification is that there are four outputs to the A-4D plant 
at level 1 (u,a,q, and theta) instead of two for the X-29 
plant (a and q) , thus there are four inputs to level 2 
instead of two. The second modification is that the network of 
level 2 emulates the small and unstable A-4D inverse plant 
instead of the large and stable X-29 inverse plant. Finally, 
the third modification is that the sampling time for the A-4D 
aircraft is 0.1 seconds instead of 0.02 seconds for the X-29 
aircraft. The sampling time being 0.1 seconds indicates that 
the A-4D longitudinal modes are slower than the X-29 dynamic 
modes . 

The SIMO and the MISO networks of Fig. 32 have learned 
to model the A-4D inverse plant after 25,000 cycles or 450 
seconds. The random binary step outputs of the inverse plant 
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network 2 (output 2) shows a very near to exact solution to 
the random binary step inputs of the plant network 1 (input 
1) , as shown in Fig. 65. The lowest RMS error obtained is on 
the order of 0.00015 or 0.015 percent of the maximum output 
value of one, as indicated in Fig. 66. Notice that the 
vertical scales are on the order 10“ . 

As expected, the speed of the simulation was much 
faster for the A-4D model of case #4 than for the X-29 model 
of case #3 since the order of the system is seven and a half 
times smaller. The order of the system in addition to the 
number of inputs and outputs determines the number of elements 
in the regression vector. The number of elements in the 
regression vector determines the number of connections in the 
neural network structure, which in turn determines the speed 
of the simulation. The smaller the order of the system, the 
smaller the number of connections required in the neural 
network, and therefore the faster the simulation. 

The discrete Bode plots of Fig. 67 through Fig. 70 
give the u, a, q, and theta frequency responses of the A-4D 
plant model and of network 1, which emulates the plant. The 
discrete Bode plots of Fig. 71 through Fig. 74 give the u, a, 
q and theta frequency responses of the A-4D inverse plant 
model and of network 2, which emulates the inverse plant. 

As with the X-29 model case #3, the spectral transfer 
function of the A-4D inverse plant of level 2 has been 
calculated using the random binary step responses of output 2 



94 



as the input vector and the u, a, q and theta input signals of 
input 2 as the output vector. Both networks, network 1 
simulating the A-4D plant and network 2 simulating the A-4D 
inverse plant, as shown in Fig. 67 through Fig. 74, have no 
difficulties to model the high frequency region. However, even 
with further training, the networks are unable to better model 
the low frequency region. The same results were obtained, in 
respect to the plant, by R. Scott [Ref. 1] . 

Knowing that the time responses of a (t) and q(t) are 
predominantly of high frequency or short period mode, it can 
be seen looking from the Bode plots that the emulations of the 
A-4D plant and its inverse have been accomplished with high 
accuracy. 
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Figure 67 A-4D Plant Model and Network 1 u Frequency 
Responses 




Figure 68 A-4D Plant Model and Network 1 a Frequency 
Responses 
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Figure 69 A-4D Plant Model and Network 1 q Frequency 
Responses 




Sea Level Frequency (Hz) Mach=.4 

Figure 70 A-4D Plant Model and Network 1 theta Frequency 
Responses 
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71 A-4D Inverse Plant Model and Network 2 u 
Frequency Responses 




Figure 72 A-4D Inverse Plant Model and Network 2 a 
Frequency Responses 
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Figure 73 A-4D Inverse Plant Model and Network 2 q 
Frequency Responses 




Figure 74 A-4D Inverse Plant Model and Network 2 theta 
Frequency Responses 
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3. Case # 5 - inverse Plant of the X-29 Aircraft 

The fifth case also analyses an open-loop transfer 
function, the X-29 fourteen order plant. As shown in Fig. 30 
and 31 of Chapter V, the A-4D plant has no unstable pole and 
one non-minimum phase zero at -3.65, whereas the X-29 plant 
has one unstable pole at +1.05 and three non-minimum phase 
zeros located at -4.5, +2.2, and +9.5. As a consequence of the 
unstable pole, the X-29 plant is unstable. As a consequence of 
the size of the X-29 non-minimum phase zeros, +9.5 and -4.5, 
versus the A-4D non-minimum phase zero, -3.65, the degree of 
instability of the X-29 inverse plant is much higher than the 
degree of instability of the A-4D inverse plant. 

In the inverse plant architecture of Fig. 29, the X-29 
plant without controller, which has not been modelled prior to 
this case, is emulated with neural network 1. The X-29 inverse 
plant is emulated with neural network 2. As shown in Fig. 29, 
only one input to the plant is necessary to investigate this 
case study. Both inputs to the plant will be analyzed in the 
third configuration when simulating the controllers and the 
plant. The same SIMO and MISO neural network structures of the 
X-29 model of case #3 are used in addition to the same number 
of outputs, 2, and the same sampling time, 0.02 seconds. The 
only exceptions are that the neural network of level 1 
emulates a smaller, unstable system (X-29 plant) and that the 
neural network of level 2 emulates a very unstable system (X- 
29 inverse plant) . 
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After 25,000 epochs or 300 seconds, neural network 1 
has learned to model the unstable X-29 plant in the time 
domain. The a and q time responses of the X-29 plant model and 
of the network 1 to a step of 0.01 degree for one second 
applied to input 1 are given in Fig. 75 and 76. The RMS errors 
are on the order of 0.0005 for a or 5.0 percent of the maximum 
output value of one, and on the order of 0.0001 for g. Notice 
in both figures the positive exponential departures of both 
responses with respect to time. This explains why a step input 
of 0.01 degree was chosen over the step input of one degree to 
test the system. These exponential responses can be controlled 
by limiting the plant outputs to a certain value. Limiting the 
plant outputs has two purposes. First, it avoids the plant 
output signals to grow exponentially. Second, since the plant 
outputs become the inverse plant inputs, it limits the control 
inputs of the inverse plant network 2. In this way the effects 
of the unstable inverse plant are restrained. 

In case #5 of the USERIO program of Appendix A, the 
generation of the system or plant outputs are limited to 
values between + 1. Every time one of the two plant outputs 
reaches +1, the same output is reset to zero. These resets 
occur approximately every 90 epochs or 1.8 seconds, which 
introduces noise every 0.5 hertz in the frequency spectrum, as 
demonstrated in Fig. 77 and 78. The mean of the noise dynamics 
in Fig. 78 follows the true plant response to a certain point, 
around 20 hertz. By applying an adequate filter, a proper 
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frequency response of the network could be more or less 
obtained . 

The very unstable inverse plant makes the task of the 
inverse plant network 2 more difficult. Even after 500,000 
epochs or 8,500 seconds, neural network 2 cannot emulate the 
inverse plant, as shown in Fig. 79. The RMS error is on the 
order of 0.6 or 60 percent of the maximum output of one. 

In summary, the second configuration could simulate 
case #3, the large order and stable optimal performance X-29 
inverse closed-loop transfer function and case #4, the small 
order, unstable A-4D inverse plant, but it could not simulate 
case #5, the more unstable X-29 inverse plant. The unstable X- 
29 plant was however emulated. 
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Figure 75 X-29 Plant Model and Network 1 a Time Responses to 
Input 1 




Figure 76 X-29 Plant Model and Network 1 q Time Responses to 
Input 1 
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AJtitude = 30000 feet Frequency (Hz) Mach=.5 

Figure 77 X-29 Plant Model and Network 1 a Frequency 
Responses to Input 1 




Figure 78 X-29 Plant Model and Network 1 q Frequency 
Responses to Input 1 
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Figure 79 RB Inputs Comparison after 500K Epochs (case #5) 

B. CONFIGURATION #3: SIMULATIONS OF THE X-29 EXISTING 
CONTROLLERS AND THE X-29 PLANT 

In the simulation of the optimal X-29 closed-loop plant of 
case #1 and in the simulation of the limited X-29 closed-loop 
plant of case #2, the entire closed-loop architecture of Fig. 
28 is emulated, whereas in case #6 and #7 each controller and 
plant is simulated separately as the open-loop architecture of 
Fig. 33. After both the controller and the plant are emulated, 
case #8 will close the open-loop model of both cases by 
connecting in series the neural network representing the 
controller and the neural network representing the plant, and 
by feeding back the errors of the plant network outputs to the 
controller network inputs, as illustrated in Fig. 33. In the 
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open-loop architecture of Fig. 33, level 1 emulates the X-29 
controller and level 2 emulates the X-29 plant. The neural 
network representation of Fig. 33 is shown in Fig. 34. The 
first MIMO neural network structure of Fig. 34 simulates the 
controller and the second MIMO neural network structure of 
Fig. 34 simulates the plant. The optimal controller case #6 
introduces a nonlinear network model, whereas the limited 
controller case #7 utilizes a linear network model. In this 
configuration, only the time domain will be analyzed since the 
interests are on the time responses of both inputs to case #8, 
as described above. 

1. Case # 6 - Simulation of the X-29 Optimal Controller 

and the X-29 Plant 

This case emulates the stable optimal, controller at 
level 1 and the plant of the X-29 at level 2. This controller 
is stable since the poles and zeros of the transfer functions 
of the two inputs are within the unit circle. 

The optimal controller is first emulated using a 
linear neural network i.e. no hidden layers. The linear neural 
network 1 has not learned to model the limited controller even 
after 200,000 epochs or 4000 sec, as shown in Fig. 80 through 
Fig. 83. The network has difficulties in simulating the 
magnitude of the linear ramps of the responses and the 
magnitude of the excursions. The best example is shown in Fig. 
82. The network could learn the ascent of the first peak, but 
it could not make the descent on time. The difficulties in 
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simulating the excursions are due to the fact that their rise 
times are approaching the sampling time of 0.02 seconds. 
Nevertheless, in all four graphs the time responses of the 
controller network, network 1, do not show any time shifts. 

Since the optimal controller could not be emulated 
using a linear network model, nonlinearity was introduced to 
see if a nonlinear network model could bring better results. 
Therefore, two non-linear networks were investigated in this 
case study. 

The first nonlinear network involves the addition of 
one hidden layer between the control input layer and the 
output layer of the controller MIMO network structure of Fig. 
34. The hyperbolic tangent function is used as the transfer 
function of the hidden layer. 

Various numbers of elements in the hidden layer have 
been tested. The best results were obtained within 25,000 
epochs or 500 seconds using 42 elements. 

The time responses of the X-29 linear, optimal 
controller and of the first nonlinear controller network to a 
step input of one degree for one second are shown in Fig. 84 
through Fig. 87. The RMS errors are on the order of 0.0001 for 
output 1 or 0.01 percent of the maximum output of one, and 
0.00005 for output 2. There are some improvements from the 
linear network responses (0 hidden layer) to the nonlinear 
network responses (1 hidden layer). Referring to the above 
mentioned figures, all the linear ramps of the responses are 
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well modelled. However, the peaks' values are not well 
represented, as shown in Fig. 86. 

The second nonlinear network involves the addition of 
two hidden layers between the control input layer and the 
output layer of the controller MIMO network structure of Fig. 
34. The first hidden layer from the bottom has the same number 
of elements as the one of the previous test, i.e., 42. To 
determine the optimal number of elements in the second hidden 
layer, a SVD analysis was carried out based on the weight 
connections of the two hidden layers. 

The SVD was calculated for different numbers of 
elements (30, 21, 12 and 5) or trials using the weight 
matrices, which are composed of the connections weights of the 
two layers. The results are given in Fig. 88 through 91. In 
all four trials, the networks have been trained using the same 
learning rate. In all SVD plots, three lines stand out, 
meaning that the optimal number of elements in the second 
hidden layer should be three. After some oscillations between 
0 and 1500 epochs, the network in all four trials (30, 21, 12, 
and 5 elements) stabilizes to constant values. For example, in 
Fig. 88 the network comprising a second hidden layer of 30 
elements stabilizes around SVD 5, 3.5, and 0.5. 

Therefore, forty-two elements in the first hidden 
layer and three elements in the second hidden layer should be 
sufficient to represent the second nonlinear network model (2 
hidden layers) . 
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The time responses of the X-29 linear, optimal 
controller and the second nonlinear network 1 to a step input 
of one degree for one second are shown in Fig. 92 through Fig. 
95. The RMS errors are on the order of 0.001 for output 1 and 
0.0004 for output 2. The responses are very similar to the 
first nonlinear network 1 (1 hidden layer). Comparing Fig. 92 
with Fig. 84, Fig. 93 with Fig. 85, and Fig. 95 with Fig. 87, 
the linear ramps of the two nonlinear networks are well 
modelled but the peaks are not well represented. Comparing 
Fig. 94 with Fig. 86, both networks responded with high peak 
values which are not present in the true optimal controller 
responses. As with the first nonlinear network (1 hidden 
layer) , no time shifts are found. 

The second part of case #6 involves the simulation of 
the X-29 unstable plant at level 2, as shown in Fig. 33. In 
the X-29 plant of case #5 only one input to the plant was 
necessary to investigate the case, whereas in case #6, case #7 
and case #8 both inputs to the plant are necessary. After 
40,000 epochs or 800 seconds, network 2 has learned to model 
the unstable X-29 plant using a MIMO network structure rather 
than a SIMO structure as in the X-29 plant case #5. It took as 
long to train the SIMO network structure as to train the MIMO 
structure. The q and a time responses of the X-29 plant model 
and of neural network 2, which emulates the plant, to a step 
of 0.01 degree for one second applied to input 2 are given in 
Fig. 96 and 97. The responses to input 1 were given in the X- 
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29 plant model of case #5. Once again, both responses have an 
exponential departure with respect to time. This time, the 
departures are in the opposite direction. As with case #5, the 



plant outputs were 
negative exponential 



limited to values + 1 to control 

responses . 



the 
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80 X-29 Optimal Controller Model and Network 1 a Time 
Responses to Input 1 ( 0 Hidden layer ) 




Figure 



81 X-29 Optimal Controller Model and Network 1 q Time 
Responses to Input 1 ( 0 Hidden layer ) 
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Figure 82 X-29 Optimal Controller Model and Network 1 a Time 
Responses to Input 2 ( 0 Hidden layer ) 




Figure 83 X-29 Optimal Controller Model and Network 1 q Time 
Responses to Input 2 ( 0 Hidden layer ) 
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84 X-29 Optimal Controller Model and Network 1 a Time 
Responses to Input 1 ( 1 Hidden layer ) 




Figure 85 X-29 Optimal Controller Model and Network 1 q Time 
Responses to Input 1 ( 1 Hidden layer ) 



114 



Degree/Second ^ Degree 



X-29 



100 r- 
80 1 
60 i 

40 




Time - sec 
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Figure 87 X-29 Optimal Controller Model and Network 1 q Time 
Responses to Input 2 ( 1 Hidden layer ) 
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SVD plot of the wgt matrix (hidden 2 - 30 elements) 




Figure 88 SVD Plot of the Wgt Matrix (Hidden 2- 30 elements) 
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Figure 89 SVD Plot of the Wgt Matrix (Hidden 2- 21 elements) 
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SVD plot of the wgt matrix (hidden 2-12 elements) 




Figure 90 SVD Plot of the Wgt Matrix (Hidden 2- 12 elements) 
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Figure 91 SVD Plot of the Wgt Matrix (Hidden 2- 5 elements) 
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Figure 92 X-29 Optimal Controller Model and Network 1 a Time 
Responses to Input 1(2 Hidden layer ) 




Figure 93 X-29 Optimal Controller Model and Network 1 q Time 
Responses to Input 1 ( 2 Hidden layer ) 
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Figure 94 X-29 Optimal Controller Model and Network 1 a Time 
Responses to Input 2 ( 2 Hidden layer ) 




Figure 95 X-29 Optimal Controller Model and Network 1 q Time 
Responses to Input 2 ( 2 Hidden layer ) 
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Figure 96 X-29 Plant Model and Network 2 a Time 
Responses to Input 2 




Figure 97 X-29 Plant Model and Network 2 q Time 
Responses to Input 2 
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2. Case # 7 - Simulation of the X-29 Limited Controller 
and the X-29 Plant 

This case emulates the stable, limited controller at 
level 1 and the plant of the X-29 at level 2, as shown in Fig. 
33. The controller is stable because the poles and zeros of 
the two inputs are within the unit circle. 

Network 1 has learned to model the limited controller 
within 20,000 epochs or 400 seconds, as shown in Fig. 98 
through 101. The RMS errors are on the order of 0.001 for a 
and on the order of 0.0005 for g. Comparing the four figures, 
the a and g time responses to input 1 show near to exact 
solutions, whereas the a and q time responses to input 2 show 
minor deviations from the true limited controller model. 
Further training did not better the results of input 2. 
Nonlinearity was also introduced to network 1 emulating the 
limited controller by adding hidden layers , but no 
improvement to the present results were found. 

The second part of case #7 involves the simulation of 
the X-29 unstable plant at level 2, as shown in Fig. 33. After 
40,000 epochs or 800 seconds, network 2 has learned to model 
the unstable X-29 plant using the same MIMO network structure 
than the optimal case #6. As with case #6, the output values 
of the plant were limited to +1 to control the exponential 
departures of the responses. 
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DEGREES/SEC h DEGREES 




98 X-29 Limited Controller Model and Network 1 a Time 
Responses to Input 1 




Figure 99 X-29 Limited Controller Model and Network 1 q Time 
Responses to Input 1 
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Figure 100 X-29 Limited Controller Model and Network 1 a 
Time Responses to Input 2 




Figure 101 X-29 Limited Controller Model and Network 1 q 
Time Responses to Input 2 



123 



3. Case #8 - Closure of the Open-Loop Model of the 

Optimal Controller of Case #6 and of the 

Limited Controller of Case #7 

After both the controller and the plant of case #6 and 
#7 are emulated, case #8 will close the open-loop model of 
both cases by connecting in series the neural network 
representing the controller and the neural network 
representing the plant, and by feeding back the errors of the 
plant network outputs to the controller network inputs, as 
illustrated in Fig. 33. 

Case #8 is divided in two parts. The first part 
examines the closure of the open-loop model of the optimal 
controller of case #6, and the second part examines the 
closure of the open-loop model of the limited controller of 
case #7. These operations are performed in case #8 of the 
USERIO program. 

In the first part of case #8, since the X-29 optimal 
controller could not be modelled exactly by the linear (0 
hidden layer) or the two nonlinear networks (1 and 2 hidden 
layers) of case #6, no solution to the closure of the open- 
loop model, case #8, was obtained. As mentioned previously, 
the peak values could not be well represented in the optimal 
controller of case #6 since the excursions' rise times were 
too close to the sampling time of 0.02 seconds. 

In the second part of case #8, since the linear neural 
network 1 of case #7 has learned to model the limited 
controller very well, a solution to the closure of the open- 
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loop model was obtained. The limited performance X-29 closed- 
loop model and the networks' a and q time responses to input 
1 and 2 are given in Fig. 102 through 105. Referring to Fig. 
98 through 101 of the limited performance case #7, the minor 
deviations of the network time responses from the true model 
explain the small time shifts occurring in the closure of the 
open-loop model responses, as shown in Fig. 102 through 105. 

In summary, the third configuration could simulate 
case #7, the X-29 limited controller and the X-29 unstable 
plant, and case #8 part II, the closure of the open-loop model 
of case #7, with high accuracy. However, the third 
configuration could not simulate the optimal controller of 
case #6 sufficiently to permit case #8 part I, the closure of 
the open-loop model of case #6, to take place. 
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TIME - SEC 

Figure 102 X-29 Closed-Loop Model and Networks a Time 
Responses to Input 1 ( Limited case ) 




Figure 103 X-29 Closed-Loop Model and Networks q Time 
Responses to Input 1 ( Limited case ) 
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TIME - SEC 



Figure 104 X-29 Closed-Loop Model and Networks a Time 
Responses to Input 2 ( Limited case ) 




Figure 105 X-29 Closed-Loop Model and Networks q Time 
Responses to Input 2 ( Limited case ) 
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VII. CONCLUSIONS AND RECOMMENDATIONS 



The neural network structures developed in this thesis 
demonstrate the ability of parallel distributed processing in 
solving adaptive control problems. Adaptive control theory 
implied a combination of a control method and a model 
estimation. The control method chosen was the Lyapunov Model 
Reference Adaptive Control (MRAC) in which the system was 
forced to follow the reference model with zero error. The 
controller itself, the weighted one step ahead prediction 
controller, involved the weighted sum of the state variables 
and the reference input. The model estimation chosen was the 
linear least square estimate in which the predicted output 
became the weighted sum of the terms in the regression vector. 
These weights were adjusted by minimizing the error between 
the network and the true X-29 responses. The implementation of 
the neural network adaptive control structure was demonstrated 
on the longitudinal dynamics of the X-29 fighter aircraft. 

Three configurations were proposed to train the neural 
network adaptive control structures to provide the appropriate 
inputs to the unstable X-29 plant so that desired responses 
could be obtained. These configurations were presented in 
eight cases. The first configuration representing the closed- 
loop architecture of Fig. 28 could simulate, with a linear 
network model, the large order and stable optimal and limited 
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performance X-29 closed-loop plants with high accuracy. The 
networks' time and frequency responses of both performance 
cases, case #1 and case #2, developed near to exact model 
solutions . 

The second configuration representing the inverse plant 
architecture of Fig. 29 could simulate in both time and 
frequency domain the large order and stable optimal 
performance X-29 inverse closed-loop transfer function, case 
#3, and the small order, unstable A-4D inverse plant, case #4. 
However, the second configuration could not simulate, neither 
with a linear nor a nonlinear network model, the more unstable 
X-29 inverse plant, case #5. 

Since the degree of instability of the X-29 inverse plant 
is much higher than the degree of instability of the A-4D 
inverse plant, the simulation of the inverse plant of the A-4D 
aircraft could be achieved easily compared to the X-29 
aircraft, whose inverse plant could not be simulated. 

The last configuration representing the open-loop 
architecture of Fig. 33 could, with a linear • network model, 
simulate the X-29 limited controller and the X-29 unstable 
plant, case #7, with high precision. In the optimal controller 
of case #6, the nonlinear neural networks, which were used to 
model the linear system, performed better than the linear 
network model. 

The use of the SVD analysis was successful in determining 
the optimal number of elements in the hidden layers. 
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Further studies are needed to develop improved 
combinations of linear and nonlinear neural network 
structures. In addition, it is important to pursue research on 
ways of reducing the computational time by means of selecting 
the proper number of elements in the hidden layers or by means 
of selecting the proper learning rates. 
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APPENDIX A: NEURALWORKS PROFESSIONAL II USERIO PROGRAM 



^************** 

* Source: 
Executable : 
Version : 

Date : 

Author: 
Project: 
Environment: 
Path: 

Description : 



***************************************************************** 

simoMonika . c 

simoMonika 

3.1 

30 August 1991 
D. Bertrand 

Neural Networks in Adaptive Control 
UNIX/SunOS C 

eileen: / f il669/home/Monika 

This is a prototype for the USERIO program spawned by 
NV70RKS Professional II to provide input and output 
vectors for the use of an adaptive control neural network. 

The program operates by running a simulation of the 
longitudinal dynamics of the X-29 and A-4 aircrafts at the 
same speed as sampling time of the network. 

The program can be used for any SIMO and MIMO linear and 
non-linear models. 

This USERIO program has been divided into cases: 

< Level 1 & 2 represent two networks superimposed > 



* 


case (c#) 


level 1 


level 2 control strat. 


remarks 


* 


1,2 


X-29, 30 states 


— 


contstrl 




only Level 1 


★ 




closed-loop conf. 








is trained 


* 

* 




(optimal & limited) 










* 


3 


X-29, 30 states 


X-29 inverse 


contstrl 


to 


1 train Level 1 


★ 




closed-loop conf,. 


closed-loop conf 








* 




(optimal) 




contstr2 


to 


i train Level 2 


★ 


4 


A4 plant 


Inverse Plant 


contstrl 


to 


train Level 1 


★ 

* 








contstr2 


to 


train Level 2 


* 


5 


X-29 Plant 


Inverse Plant 


contstrl 


to 


train Level 1 


* 

it 








contstr2 


to 


train Level 2 


it 


6,7 


X-29 Controllers 


X-29 Plant 


contstr2 


to 


train each Level 


* 

* 




(Optimal & Limited) 








individually 


★ 


8 


ti (i tr ii ii ii ii ti 


it ii ii n ii 


ii ii ii ti 


to 


test case 6,7: 



case 3,4,5 



connect in series & feedback 



In these three cases, two major operations are performed : 

-connecting the plant and the inverse plant networks in series 
-presenting the desired output to the inverse plant network. 
These operations are accomplished in the case request 
RQ_LEARNRSLT when identifying the output layer, 

if ( IOCOUNT == NUM_OUT && IOLAYER ~ out_lay) { 

... for (i=0; i<num_out; i++) { 

command2 [ i ]=out [ i ] ; ..meaning that alpha(t) and q(t) 

become the input of the inverse 
plant . 



} 

out2 [ 0 ] =command [ 0 ] ; 



.meaning that r(t-l), the ref. input 
becomes the desired output of the 
inverse plant. 
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* }. . . 

* 

* case 6 & 7 

* In these two cases, both networks are trained separately. 

* The connections between the networks will be done in case /8. 

* 

* case 8 

* In this case, two major operations are performed on case #6 & 7: 

* -connecting the controller and the plant networks in series, 

* -feeding back to the controller inputs the error between the 

* network plant outputs and the reference inputs 

* These operations are accomplished in the case request 

* RQ_LEARNRSLT when identifying the plant and the controller layers 

* 

* if ( IOCOUNT “ num_out && IOLAYER==out_lay ) { 

* ... for(i=0; i<num_out; i++) { 

* command2 [ i ]=out [ i ] ; ..meaning that the controller outputs 

* become the plant inputs. 

* } 

* }... 

★ 

* if (IOCOUNT — num_out2 && I0LAYER==out2_lay) { 

* ...for(i-0; i<num_out2 ; i++) { 

* command[ i]=command[ i]-out2 [i] ;. .meaning that the controller 

* inputs become the error 

* between the plant outputs 

* and the reference in puts. 

* }... 

* }... 



* 

* 

* Three different inputs are available: 

★ 

* Input 1 - Random Binary 

* Input 2 - test input 1 with a pulse of 1 degree for 1 sec 

* Input 3 - test input 2 with a pulse of 1 degree for 1 sec 

* 

******************************************************************************* 



/* Include the following external modules */ 



/include <stdio.h> 

/include <math.h> 

/include "userutl . h" 

/* /include "transf er30hp. h" 

/* /include "transf er301im. h" 
/* /include "transf erhpl inv . h" 
/* /include "transf erA4 inv . h" 
/* /include "transf erl4inv. h" 
/* /include "transferl614hp.h" 
/include M transf er!61 4hp . h" 



File of 
File of 
File of 
File of 
File of 
File of 
/* File of 



parameters 

parameters 

parameters 

parameters 

parameters 

parameters 

parameters 



for case 1 
for case 2 
for case 3 
for case 4 
for case 5 
for case 6 
for case 7 



(optimal) */ 
(limited) */ 
(X29) */ 
(A4)*/ 

(X29 ) */ 
(Optimal) */ 
(Limited) */ 



/* Neuralworks calls the USERIO program through the function UsrIO */ 

int UsrIO ( ) 

{ 

/* Declarations */ 



extern double ts; 
extern double iterations; 
extern double pow(); 
extern double fmod(); 



/* Sampling time */ 

/* number of iterations */ 
/* Power function */ 

/* Remainder function */ 
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extern 

extern 

extern 

extern 

extern 

extern 

extern 

extern 

extern 



long random ( ) ; 
char * input_name [ ] ; 
double nural [ num_in] [ 
double denlfordl]; 
double num2 [ num_in2 ] 
double den2[ord2]; 
double alphal; 
double alpha2; 
double alpha3; 



/* Random number generator */ 

/* Names of inputs */ 
num_out ] [ ordl ] ; /* Numerator coefficients 
/* Denominator coefficients 
[ num_out2 ] [ ord2 ] ; / * Numerator coefficients 
/* Denominator coefficients 
/* Place holder for Command[]*/ 

/* Place holder for Command[]*/ 

/* Place holder for Command[]*/ 



*/ 

*/ 

*/ 

*/ 



static int profile={0}; 
static int redraw, in={ 0} ; /* 

static double checkl; /* 

static double check2; /* 

static double count={0.0}; /* 

static int input; /* 



Redisplay initialization flag */ 
Check flag */ 

Check flag */ 

Display counter */ 

Selected input */ 



static 

static 



double rmem, rmeml , rmem2 ; /* Counters for inputs 

double rcount , rcountl , rcount2 ; /* Counters for inputs 
int h,i,j,imax; /* Indices */ 

char buf[90]; /* Display buffer */ 

char *sp; /* String pointer */ 



*/ 

*/ 



/* Feedback regression vectors */ 

static double f eedback [ num_f eed ] = { 0 . 0 } ; 
static double f eedback2 [ num_f eed2 ] ={ 0 . 0 } ; 

/ *Ref input + regression vectors */ 

static double command [ num_comd ] = {0.0}; 

static double command2 [ num_comd2 ]= {0.0}; 

/* Regression vectors applied to NN */ 

static double control [ num_cont ]= {0.0}; 

static double control2 [ num_cont2 ] = {0.0}; 

/* Plant responses to regression vectors *./ 

static double out [ num_out ] = { 0 . 0 } ; 
static double out2 [ num_out2 ]={ 0. 0} ; 



/* Definitions */ 

/define MAXRAND (0x7f f f f f f f 1) 
/define rand random 

/* Definitions of Level 1 */ 



/define feedback_lay 0 
/define command_lay 1 
/define control_lay 2 

/* /define hiddenl_lay 3 For non-linear models */ 
/* /define hidden2 lay 4 */ 

/define outplay 3 
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/* Definitions of Level 2 */ 

/define f eedback2_lay 4 
/define comma nd2_l ay 5 
/define control2_lay 6 
/define out2__lay 7 



/* initialization (if necessary) */ 
IORTNCDE = 0; 

switch ( IOREQCDE ) { 



/* 



case RQ_ATTENTION : 

/* User select input to be used */ 

Again3 : 

sprintf ( buf , "\nEnter Desired Input Type (1. %s, 2. %s, 3. %s, 4. %s" 
input_name ( 1 ] , input_name [2] , input_name [ 3 ) ) ; 

PutStr ( buf ) ; 
sp=GetStr ( ) ; 

sscanf ( sp, n %ld H , &input) ; 
if( input >3. || inputcl. ){ 

sprintf ( buf, ,, \n%s" , input_name [ 0 ] ); 

PutStr ( buf ) ; 
f or ( i=0 ; i<1000; i++) { 

} 

goto Again3 ; 

} 



/* Display selections */ 

sprintf ( buf # " \nlnput : %s selected”, 

input^name [ input ] ) ; 

PutStr ( buf ) ; 
if(input== 2 . || input==3.){ 

PutStr (" \nEnsure LR is set to zero for test”) ; 

} 

i n= 1 ; 
break; 



case RQ_REWIND: 

/* Occurs at the start of a "learn all". 

* Rewind any input files to the beginning. */ 

count=0 . 0 ; 
break ; 



case RQ_LSTART: 

/* Learn start; occurs once at the start */ 
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/* initialize input if not already done so */ 



if ( in==0) { 

input=l ; 
in=l ; 



} 

I* check if user wishes to redisplay after every plot reaches the end */ 

PutStr ( " \nHow often do you wish to redraw the screen (0 for never)?") 
sp=GetStr ( ) ; 

sscanf ( sp, "lid", Sredraw) ; 



/* start random binary or composite in time sequence */ 

if (num_in==l ) { 
if ( input==l ) { 

rcount=0 . 0 ; 

rmem=rand() % 4; 

command [ 0]=pow(-l . 0, rmem) ; 

} 

} 

if (num_in==2 ) { 
if ( input==l) { 

rcountl=0 . 0 ; 

rcount2=0 . 0 ; 

rmeml=rand() % 4; 

rmem2=rand() % 4; 

command [ 0 ] =pow ( -1 . 0 , rmeml ) ; 

command [ 1 ] =pow (-1 . 0 , rmem2 ) ; 

if (c==6 || c==7 ) { 

command2 [ 0]=pow(-l . 0, rmeml) ; 
command2 [ 1 ) =pow (-I . 0 , rmem2 ) ; 

} 

} 

} 



/* start test with a pulse of 1 degree for 1 sec */ 

if (num_in==l) { 
if ( input“2 ) { 

rcount=50 . 0 ; 
command [ 0]=alphal ; 

} 

} 

if (num_in==2 ) { 
if ( input==2 ) { 

rcountl=50 . 0 ; 
rcount2=50 . 0 ; 
command [ 0 ] =alphal ; 
command [ 11=0.0; 
if (c==6 II c==7 ) { 

command2 [0]=alpha3; 
cominand2 [ 1 ]=0 . 0 ; 

} 

} 
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if ( input==3 ) { 



} 



rcount 1=50 . 0 ; 
rcount2=50 . 0; 



=alphal ; 

= 0 . 0 ; 
c==7) { 
command2 [ 1 ] =a lpha3 ; 
command2 [ 0 ] =0 . 0 ; 



command [ 1 
command [ 0 
if (c==6 | 



/* display the starting conditions */ 

sprintf( buf, "\nCycles: %f Input: %s", 

count, input_name [ input }) ; 

PutStr ( buf ) ; 
break ; 



/* 



case RQ_LEARNIN: 

/* The input values should be stored in IODATA array */ 



/* input feedback layers to the network */ 

if ( IOLAYER==f eedback_lay && IOCOUNT==num_f eed ){ 
for( i=0; i<num feed;i++ ){ 

IODATA [I] = feedback [ i ] ; 



} 



} 



if ( I0LAYER==f eedback2_lay && IOCOUNT==num_f eed2 ) { 
for( i=0; i<num_f eed2 ; i++ ){ 

IODATA [ i ] =f eedback2 [ i ] ; 



} 



} 



/* input commmand layers to the network */ 

if( IOLAYER==command_lay && IOCOUNT==num_comd) { 
for ( i=0; i<num_comd; i++) { 

IODATA [ i ] =command [ i ] ; 

} 

} 

if( IOLAYER==command2_lay && IOCOUNT==num__comd2) { 
for ( i=0 ; i<num_comd2 ; i++) { 

IODATA [ i ] =command2 [ i ] ; 

} 

} 



break ; 
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case RQ__WRSTEP: 

/* output control layer from network */ 
break ; 



/* 



case RQ_LEARNOUT : 

/* present plant or model responses to the network */ 

if ( IOLAYER==out_lay && IOCOUNT==num_out) { 
f or ( i=0 ; i<num_out ; i++) { 

IODATA [ i ] =out [ i ] ; 

} 



if ( IOLAY ER==out 2_lay && I0C0UNT==num_out2 ) { 
f or ( i=0 ; i<num_out2 ; i++) { 

IODATA [ i ] =out2 [ i ] ; 

} 

} 

break ; 



/* 



case RQ_LEARNRSLT: 

/* control outputs from network */ 

if ( IOLAYER==control_lay && IOCOUNT==num_in) { 

if ( num_in==l ) { 

f or ( i=0 ; i<num_cont ; i++) { 

control [ i ]=command [ i ] ; 

} 

control [0]=IODATA[0] ; 



if (num_in==2) { 
imax=ordl ; 
if (num_out==l) { 

imax=reg_vecl ; 

} 

for ( i=0 ; i<imax; i++) { 

control [ i ]=command [ i+num_out~l ] ; 

} 

for ( i=2 ; i<num_in+l ; i++) { 
imax=ordl* i ; 
if (num__out==i ) { 

imax=reg_vecl ; 

} 

if (num_out>i-l) { 

for ( j=ordl* ( i-1 ) +1 ; j<imax; j++) { 

control [ j ]=command[ j+num_out-i ] ; 

} 

} 

} 

for ( i=0 ; i<num_in ; i++) { 
control [ordl*i]=IODATA[i ] ; 

} 

} 
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/* generate system and model response to this control input */ 



f or ( i-0 ; i<num_out ; i++) { 
out [ i ]=0 . 00 ; 
f or (h=0 ;h<num_in ;h++) { 
f or ( j=0 ; j<ordl ; j++) { 

out [ i ]=out [ i ] + numl [ h ] [ i ] [ j ] * (control [ ordl*h+ j ] ) ; 

} 

} 

f or ( j=0 ; j<ordl ; j++) { 

out [ i ]=out [ i ] +denl [ j ] * (control [ ordl* ( i+num__in) + j ] ) ; 
} 

} 



if (I0C0UNT==num_out && IOLAYER==out_lay) { 

/* shift the regression vectors */ 

if (num_in==l) { 

f or ( i=0 ; i<num_f eed ; i++) { 

f eedback [ i ] =control [ i ] ; 

} 

for ( i=0 ; i<num_f eed ; i++ ) { 

command [ i+1 ] =control [ i ] ; 

} 

} 

if (num_in>l) { 

for ( i=l ; i<num_out+i ; i++) { 
imax=ordl*i-l ; 
if (num out-=i) { 

Imax=reg_vecl-1 ; 

} 

if (num_out>i-l) { 

for ( j=ordl* ( i — 1 ) ; j<imax; j++) { 

feedback [ j- ( i-1) ]=control [ j ] ; 
command [ j+num_out- (i-1) ]=control [ j ] ; 
} 



/* generate a new random binary input */ 

if (num_in==l ) { 
if ( input==l) { 

rcount++ ; 

command [ 0 ] =alphal ; 
if (fmod (count, 2 . 0) <1. 0) { 
rmem=rand() % 4; 
command [ 0] =pow (-1 . 0 , rmem) ; 
a Ipha l-command [ 0 ] ; 
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if (num_in==2 ) { 

if ( input==l) { 

rcount 1 + 4 ; 
command [ 0 ] =alphal ; 
command [ 1 ] =a lpha2 ; 
if ( f mod (count , 2 . 0) <1 . 0) { 
rmeml=rand() % 4; 
rmem2=rand() % 4; 
command [ 0 ] =pow (-1 . 0 , rmeml ) ; 
command [ l]=pow(-i. 0,rmem2) ; 

alphal=command [ 0] ; 
alpha2=command [ 1 ] ; 



} 



} 



} 



/* generate a new test (pulse of 1 degree for 1 sec) input */ 

if ( num_in==l ) { 

if ( input==2 ) { 
rcount --; 
command [ 0 ] =alphal ; 
rmem=200 ; 
if ( rcount<=0 . 0 ) { 
rmem— ; 

command [ 0 ] =0 . 0 ; 
if (rmem<=0 . 0) { 
rcount=50 . 0 ; 
alphal=l . 0 ; 



if (num_in==2 ) { 
if ( input==2 ) { 
rcountl 

command [ 0 ] =alphal ; 
command [ 1 ]=0 . 0 ; 
rmem 1=2 00 ; 
if ( rcount 1<=0 . 0) { 
rmeml-- ; 
command [ 0 ] =0 . 0 ; 
if (rmeml<=0 . 0) { 
rcountl=50 . 0 ; 
alphal=l . 0 ; 

} 

} 

} 

if ( input==3 ) { 
rcountl — ; 
command [ 1 ]=alphal ; 
command [ 0 ] =0 . 0 ; 
rmeml=200 ; 
if (rcountl<=0 . 0) { 
rmeml-- ; 
command [ 1 ]=0 . 0 ; 
if (rmeml<=0 . 0) { 
rcount 1=50 . 0 ; 
alphal=l . 0 ; 
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} 



} 



} 



} 



/* load the regressors with system and model responses */ 



f or ( i=0 ; i<num_out ; i++) { 

command [ ord 1 * ( i+num_in) ] =-out [ i ] ; 
feedback [ ord 1 * ( i+num_in) -num^in ] =-out [ i ] ; 

} 



/* load the input of Level 1 to the output of Level 2 */ 

if (c==3 || c==4 || c==5) { 

out2 [ 0 ] =command [ 0 ] ; 

} 

/* load the outputs of Level 1 to the inputs of Level 2 */ 

if (c==3 || c==4 || c==5 || c==8 || ){ 

f or ( i=0 ; i<num_out ; i++ ) { 
command2 [ i ] =out [ i ] ; 

} 

} 



/* increment the counter and update displays as necessary */ 
count++ ; 

checkl=fmod (count , 1000 . ) ; 
if ( check 1< 1 . 0 ) { 

sprintf ( buf, n \nCycles: %f Input: Is", 

count , input^name [ input] ) ; 

PutStr ( buf )? 

if (c==5 || c==6 || c==7 ) { 
if ( input==l ) { 

for ( i=0 ; i<num_out ; i++ ) { 

if (out [ i ] > 1 . 0 || out [ i ] <-l . 0 ) { 

for ( i=0 ; i<num_f eed ; i++) { 

f eedback [ i ] =0 . 0 ; 
command[ i+num_in]=0 . 0 

} 



} 



} 



} 



if (redraw 1=0) { 



} 



if 

} 



( f mod ( count , (double) redraw) <1 . 0) 
IORTNCDE=l; 



{ 
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/ 



ONLY FOR CASES 3 TO 8 



/ 



if ( IOLAYER==control2_lay && IOCOUNT==num_in2 ){ 

imax=ord2 ; 
i f (num_in2==l ) { 

imax=reg_vec2 ; 

} 

for ( i=0 ; i< imax ; i++ ) { 

control 2 [ i ] =command2 [ i+num_in2-l ] ; 

} 

for ( i=2 ; i<num_in2+l ; i++) { 
imax=ord2*i ; 
if (num_in2==i ) { 

imax=reg_vec2 ; 

} 

if (num_in2>i-l ) { 

for ( j=ord2* (i-l)+l ; jcimax; j++) { 

control 2 [ j )=command2 [ j+num_in2-i ] ; 

} 

} 

} 

for ( i=0 ; i<num_in2 ; i++) { 
control 2 [ord2*i ]=IODATA[ i ] ; 

} 

/* generate system and model response to this contro!2 inputs */ 

if (c==6 || c==7 || c==8 ) { 

f or ( i=0 ; i<num__out2 ; i++) { 
out 2 [ i ] =0 . 00 ; 
f or (h=0 ; h<num_in ; h++) { 
f or ( j- 0 ; j<ord2 ; j++) { 

out2[i]=out2[i]+num2[h] [i] [ j ] * (control2 [ ord2 *h+ j ] ) ; 
} 

} 

f or ( j=0 ; j<ord2 ; j++) { 

out2 [ i ] =out2 [ i ] +den2 [ j ] * (control2 [ ord2* ( i+2 ) + j ] ) ; 

} 

} 

} 

} 



if (I0C0UNT==num_out2 && I0LAYER==out2_lay) { 

/* shift the regression vectors */ 

for ( i=l ; i<num_out+l ; i++) { 
imax=ord2 *i-l ; 
if (num_out==i ) { 

imax=reg_vec2 - 1 ; 

} 

if ( num_out>i-l ) { 

for ( j=ord2* (i-1) ; j<imax; j++) { 

feedback2[ j-(i-l) ] ^control 2 [ j ] ; 
command 2 [ j +num_out- ( i-1 ) ]=control2 [ j ] ; 
} 

} 

} 
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/* generate a new random binary input */ 



if (c==6 || c==7 ) { 
if ( input==l ) { 

rcount2++; 
command 2 [ 0 ] =alphal ; 
command 2 [ 1 ] =a lpha2 ; 
if (fmod (count, 2 . 0) <1 . 0) { 
rmeml=rand() % 4; 
rmem2=rand() % 4; 
command2 [ 0 ) =pow ( -1 . 0 , rmeml ) ; 
command2 [ 1 ] =pow (-1.0, rmem2 ) ; 

a lphal=command2 [ 0 ] ; 
alpha2=command2 [ 1 ] ; 

} 



} 



} 



/* generate a new test (pulse of 1 degree for 1 sec) input */ 

if ( c==6 | | c—~l ) { 
if ( input==2 ) { 
rcount2 — ; 
command 2 [ 0 ] =a lpha3 ; 
command2 [ 1 ] =0 . 0 ; 
rmem2- 2 00 ; 
if (rcount2<=0.0) { 
rmem2 — ; 

command 2 [ 0 ] =0 . 0 ; 
i f ( rmem2 < = 0 . 0) { 

rcount2=50 . 0 ; 
a lpha3=0 . 001 ; 

} 

} 

} 

if ( input==3 ) { 
rcount2 

command 2 [ 1 ]=alpha3 ; 
command2 [ 0 ] =0 . 0 ; 
rmem2=200 ; 
if ( rcount2<=0 . 0) { 
rmem2— ; 

command2 [ 1 ] =0 . 0 ; 
if (rmem2<=0 . 0) { 
rcount2=50 . 0 ; 
a lpha3=0 . 001 ; 

} 

} 

} 

} 

/* load the regressors with system and model responses */ 

if (c==3 I I c==4 I I c==5) { 

command2 [ ordl *num_out ]=-out2 [ 0 ] ; 
feedback 2 [ (ordl-1 ) *num_out ]=-out2 ( 0) ; 

} 

if (C==6 | | c==7 || c==8){ 

for (i=0; i<nuin_out2 ; i++) { 

command 2 ( ord2* ( i+2) ]=-out2 [ i ] ; 
feedback2 [ord2* (i+2) -2 ]=-out2 [ i] ; 

) 

> 
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/* calculate the error value going into the controller (feedback loop) */ 



if (c==8) { 

for ( i=0 ; i<num_out2 ; i++) { 

command [ i ] =command [ i j -out2 [ i ] ; 

} 

} 



/* increment the counter and update displays as necessary */ 

if (c==6 || c==7 ) { 
if ( input==l ) { 

for ( i=0 ; i<num__out2 ; i++) { 

if (out2 [ i ] > 1 . 0 || out2 [ i ] <- 1 . 0 ) { 

for ( i=0 ; i<num_f eed2 ; i++) { 

f eedback2 [ i ]=0 . 0 ; 
command 2 [ i+num_in]=0 . 0 ; 

} 



} 



} 



} 



break ; 



/* 



case RQ__LEND : 

/* end learning mode, display current status */ 

sprintf( buf, "\nCycles: If Input: Is”, 

count, input_name [ input ]) ; 
PutStr ( buf ); 

break ; 



case RQ_RSTART : 



break; 



case RQ_READ : 



break ; 



case RQ__WRITE: 
break ; 
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case RQ_RCLTST : 
break ; 

case RQ_REND: 

/* end recall , display current status */ 

sprintf( buf , "\nCycles: %f Input: %s", 

count, input_name [ input ]) ; 
PutStr( buf ); 



break ; 

case RQ_TERM : 

/* terminate userio */ 

sprintf ( buf, "\nCycles: %f", 

count) ; 

PutStr ( buf ) ; 

break ; 

> 

return ; 



146 



APPENDIX B: NEURALWORKS PROFESSIONAL II CONTROL STRATEGIES FILES 



csv2 . 1 

Ifile format is Control Strategy Version 2.1 



! Source: contstrl.nnc 

! Executable: neuralworks professional II 

l Version: 2 

l Date: 30 Aug 1991 

! Author: D. J. Collins 

\ Co-Author D. J. Bertrand 

i Project: Neural Networks in Adaptive Control 

l Environment: UNIX/SunOS/Neuralworks Control Strategy 
! Path: eileen: / f il669/home/monika 

! Description: This is a prototype control strategy for use with 
1 the simomonika USERIO program. 

! This strategy uses a proprietary language which is covered 

! in some detail in the Neuralworks Professional II manual. 

! This control strategy applies only for cases 1, 2, 3, 4 & 5 

! which require Level 1 to be trained first. 

! Each network must use the back-propagation learning concept, and 

! possesses at least an input or feedback layer, a control or 

! command layer, and an output layer. 



Revisions: Handles all hidden layers 



MASK label 


op-code 


operands 


comment 






» saRisa 


trace 


aux3 


! 


set 


trace option to 


aux3 


>T_aRisa 


cset 


recall , 0 


i 


recall count 




Get inputs for 


■ Level 


1 (learn and 


recall) 








._saRisa 


lset 


in 


i 


set 


feedback layer 


or input 


saR 


io 


lrnin 


i 


get 


feedback vector 


learn 


- Risa 


io 


read 


i 


get 


feedback vector 


recall 


»_saRisa 


lset 


cur , 1 


i 


set 


command layer 




» saR 


io 


lrnin 


i 


get 


command vector 


learn 


» Risa 


io 


read 


i 


get 


command vector 


recall 



Start forward pass to but not including output layer 



L saRisa 


lset 


in 






L_saR 


@loopl math 


sum 


lnoise 


tran 


L Risa 


math 


sum 


rnoise 


tran 


L_saRisa 


lset 


cur , 


r 1 




L_saRisa 


lcmp 


in, +3 




L_saRisa 


bit 


@loopl 





Transfer control vector to userio and 



L_saRisa 


lset 


in, +2 


L_saR 


io 


lrnrslt 


L Risa 


io 


write 


L_saRisa 


lset 


in , +3 


L_saR 


io 


lrnout 


L Risa 


io 


rcltst 



i 



! set feedback layer or input 
output I e=0 | f ire 1 fire 0th layer learn 
output|e=0 ! fire 0th layer recall 
! set next layer learn & recall 
! at output layer ? 

I loop till done 

get desired output 

! set control layer learn and recall 
! sent control input learn 

! sent control input recall 

! set output layer learn and recall 
! get output layer desired learn 
! get output layer desired recall 
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! Compute final outputs at output layer 

i 



L saR 


math 


sum 


lnoise 


ce=e 


tran 


output 


e-=w 


f ire | e*=ef | swap | f ire 


L Risa 


math 


sum 


lnoise 


ce=e 


tran 


output 


e-=w 


swap !recall 



L Risa eos 

i 

I write results to userio 



L_saR io lrnrslt 

L Risa io write 



! sent output learn 
! sent output recall 



learn cycle back propagate error 



(note at output layer) 



L 


saR 


math 


i=e | e=ce 


L 


saR 


§lloop math 


ce=e | e*=f 


L 


saR 


lset 


cur , -I 


L 


saR 


lcmp 


in 


L 


saR 


bgt 


0 1 loop 


If 


a Risa 


trace 


0 



! put desire value in sum field 
| backp | learn | f ire ! bkp/learn 3rd 
! previous layer 

! at input layer? 

! loop till done 

! turn off any trace function 



Note, when viewing an output node, output contains the network result, 
sum contains the desired result, and ce contains the error. 
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csv2 . 1 

Ifile format is Control Strategy Version 2.1 



i 

! 



Source : 
Executable : 
Version : 

Date : 

Author : 
Project : 
Environment : 
Path: 

Description : 



contstr2 . nnc 

neuralworks professional II 
2 

30 Aug 1991 
D. J. Bertrand 

Neural Networks in Adaptive Control 
UNIX/SunOS/Neuralworks Control Strategy 
eileen: /f i 1669/home/Monika 

This is a prototype control strategy for use with 
SimoMonika . c, the USERIO program. 

This strategy uses a proprietary language which is covered 
in some detail in the Neuralworks Professional II manual. 
This program is a continuity to contstral . nnc . 



For cases 3,4 & 5 : 

After Level 1 has been trained with contstral, 

Level 2 is then trained with this control strategy using 
the inputs and outputs of Level 1 as references. 

For cases 6 & 7 : 

Contstral is not necessary, since both Level 1 & 2 can 
be emulated simultaneously with contstra2. 

For case 8 : 

No training takes place. Make sure LR is set 
to zero before using contstra2. 



•MASK label 


op-code 


operands 


comment 






L_saRisa 


trace 


aux3 


j 


set 


trace option to 


aux3 


Li aRisa 

i 


cset 


recall , 0 


j 


recall count 




! Get inputs 

i 


of Level 


1 (learn and 


recall) 








L__saRisa 


lset 


in 


i 


set 


feedback layer 


or input 


L_saR 


io 


lrnin 


j 


get 


feedback vector 


learn 


L Risa 


io 


read 


i 


get 


feedback vector 


recall 


L_saRisa 


lset 


cur , 1 


j 


set 


command layer 




L_saR 


io 


lrnin 


i 


get 


command vector 


learn 


L Risa 


io 


read 


i 


get 


command vector 


recall 



! 

! Start forward pass to but not including output layer 

i 



L saRisa 


lset 


in 




L_saR §loopl 


math 


sum 


lnoise 


L R l s a 


math 


sum 


rnoise 


L_saRisa 


lset 


cur, 


, 1 


L_saRisa 


lcmp 


in, +3 


L saRisa 

i 


bit 


@loopl 


! Transfer control vector to useri< 

i 


L__saRisa 


lset 


in, +2 


L saR 


io 


lrnrslt 


L Ri sa 


io 


write 



! set feedback layer or input 
output I e=0 | f ire ifire 0th layer learn 
output j e=0 I fire 0th layer recall 
! set next layer learn & recall 
! at output layer ? 

! loop till done 



set control layer learn and recall 
sent control input learn 

sent control input recall 
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r r r — — — t- r t 1 r r r — — — r tr 1 tr 1 r t - 1 r — — — — r r tr 1 r f r — tr* f r r t - 1 • — — r t - 1 — — — r t* t* 



set output layer learn and recall 
get output layer desired learn 
get output layer desired recall 

Compute final outputs at output layer 



L_saRisa lset in, +3 

L_saR io lrnout 

L Risa io rcltst 



saR 

Risa 

Risa 



math 

math 

eos 



sum I Inoise I ce=e tran output I e-=w I f ire | e*=ef | swap | f ire 
sum I lnoise I ce=e tran output | e-=w | swap Irecall 



write results to userio 



saR 

Risa 



io lrnrslt 

io write 



sent plant output learn 
sent plant output recall 



learn cycle back propagate error 



(located at output layer) 



saR math 

saR 0 loop2 math 

saR lset 

saR lcmp 

saR bgt 



i=e | e=ce ! put desire value in sum field 

ce=e | e*=f ' | backp | learn | f ire ! bkp/learn 3rd 
cur,-l ! previous layer 

in ! at input layer? 

01oop2 ! loop till done 



note that the error does not need to be backpropagated if using cases 2 & 3. 
It has already been trained using estimatl . nnc . 



Get inputs of Level 2 (learn and recall) 



saRisa 


lset 


in , +4 


saR 


io 


lrnin 


Risa 


io 


read 


saRisa 


lset 


cur , 1 


saR 


io 


lrnin 


Risa 


io 


read 



set feedback2 layer or input 
get feedback2 vector learn 
get feedback2 vector recall 
set command2 layer 
get command2 vector learn 
get command2 vector recall 



Start 



forward pass 



to but not including output2 layer 



saRisa 


lset 


in , +4 




saR 


01oop3 math 


sum 


Inoise 


tran 


Risa 


math 


sum 


rnoise 


tran 


saRisa 


lset 


cur , 


, 1 




saRisa 


lcmp 


in , -*-7 




saRisa 


bit 


0 loop3 





1 set feedback2 layer or input 
output e=0|fire Ifire Oth layer learn 
output e=0 ! fire Oth layer recall 

! set next layer learn & recall 
1 at output2 layer ? 

! loop till done 



Transfer control2 vector to userio and get desired output2 



saRisa 


lset 


in , +6 


saR 


io 


lrnrslt 


Risa 


io 


write 


saRisa 


lset 


in , +7 


saR 


io 


lrnout 


Risa 


io 


rcltst 



! set control2 layer learn and recall 
! sent control2 input learn 

I sent control2 input recall 

! set output2 layer learn and recall 
! get output2 layer desired learn 
\ get output2 layer desired recall 



Compute final outputs at output2 layer 



L_saR 


math 


sum | Inoise 


ce=e 


tran 


output 1 e-=w 1 


I fire | e*=ef | swap | fire 


L Risa 


math 


sum | Inoise 


ce=e 


tran 


output | e-=w | 


[swap Irecall 



Risa eos 
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write results to userio 



! sent output 2 learn 
! sent output2 recall 

(note at output2 layer) 



L s a R 

L Risa 



10 

io 



lrnrslt 

write 



learn cycle back propagate error 



L 


saR 


math 


i=e | e=ce 


If 


saR 


@ loop4 math 


ce=e | e *=f 


If 


saR 


lset 


cur , -1 


If 


saR 


lcmp 


in, +4 


If 


saR 


bgt 


01oop4 


If 


aRisa 


trace 


0 



! put desire value in sum field 
| backp | learn | f ire ! bkp/learn 3rd 
! previous layer 
! at input2 layer? 

! loop till done 

! turn off any trace function 



Note, when viewing an output node, output contains the network result, 
sum contains the desired result, and ce contains the error. 
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APPENDIX C: NEURALWORKS PROFESSIONAL II HEADER FILES 



/ : * *************************************************************************** 



* 11 april 1991 * 

* transfer30hp.txt (Optimal case ) * 

* Header file for transfer function variables * 

* Sampling time 0.02 sec * 

* CAPT D. Bertrand * 



****************************************************************************/ 

/* Define the case / */ 

/define c 1 /* X-29, 30 states closed-loop conf. */ 



/* Define the variables */ 



/* Level 1 */ 

/define ordl 30 
/define num_in 2 
/define reg_vecl 120 
/define num_feed 118 
/define num_comd 120 
/define num_cont 120 
/define num out 2 



/* order of the X-29 closed-loop conf. */ 

/* number of inputs to the X-29 closed-loop conf.*/ 
/* regression vector =ord* (num_in+num_out) */ 

/* feedback layer =reg_vec-num_in */ 

/* command layer = reg_vec */ 

/* control layer = reg_vec */ 

/* output layer = num_out */ 



/* Level 2 



( not required ) */ 



/define ord2 1 /* 
/define num_in2 1 /* 
/define reg_vec2 1 /* 
/define num_feed2 1 /* 
/define num_comd2 1 /* 
/define num_cont2 1 /* 
/define num_out2 1 /* 



order of the X-29 inverse closed-loop conf.*/ 

number of inputs to the X-29 inverse closed-loop*/ 

regression vector =ord* (num_in+num_out ) */ 

feedback2 layer = reg_vec-num_out */ 

command2 layer= reg_vec */ 

control2 layer = reg_vec */ 

output2 layer = num_in */ 



/* Declarations */ 

static double ts={0.02}; 
static double alphal={ 1 . 0 } ; 
static double a lpha2 = { 0 . 01 } ; 
static double alpha3 = { 0 . 001 } ; 

static char *input_name []={ "Illegal Input" , "Random Binary", 

"A Pulse input of 1 degree for 1 sec (input 1 )","( input 2)"}; 



static char *state_name []={ "Illegal State" , "u (t) " , "a lpha ( t ) " , 
"q(t)\ "theta (t)"}; 



/* Numerator coefficients of the X-29 closed-loop conf. */ 
/* Order is al-a30 & ql-q30 for the indices */ 

static double numl [ 2 ] [ 2 ] [ 30]= 

{ 7 . 21794 179 01 239 16e-03 , 

4 . 136 1273 829103 60e-02 , 

-4 . 669768974 859352e-01, 
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1 . 7 4 091537 89107 8 5e+00, 
-3 . 8609720794 9063 7e+00, 
5. 91002 6001 8 63 514 e + 00, 
-6. 603623724905617e+00, 
5. 461815191735525e+00, 
-3. 2701589875142366+00, 
1 . 27 66 67 299 594 394e + 00 , 
-1.5207540746008876-01, 
-2 . 0511 5904 97 927 66e-01 , 
1. 94 53 4 55561 3528 5e-01 , 
-1. 05600984 077 9120e-01, 
4 .3 050248 168023 05e-02, 
-1 .4215644 2 5160682e-02 , 
3 . 8904 6 58137 292606-03 , 
-8.7538785764993036-04 , 
1. 567504967623089e-04 , 
-2.108457015082093e-05, 
1.9254190959238406-06, 
-9. 276539501321390e-08 , 
-7 . 822 692 1891 163 82e- 10, 
3 . 6066584 558 3014 5e-10, 
-1 .731282 4 3764 2258e-ll, 
2. 8 28 8 3 022 3 4 3908 7e-l 3 , 
-1.03551324 54 05491e-l5, 
3. 084 62 54 7 537 607 8e-17, 
6. 087629110463293e-20, 
2. 188724968031335e-33, 
3 . 03 027 9064 2 4 8020e-02 , 
-2 . 1766173 633 11379e-01 , 
7 . 199418522371559e-01, 
-1 . 44 58 87 4688 3 124 5e+ 00, 
1 .937 2 32 4 3 87 53 2 56e + 00, 
-1. 7 44 0105851 39847e+00, 
9. 04619103077 0956e- 01 , 
7. 52 098 38 3 8907 114 e-02, 
-6.942919440655828e-01, 
8. 18 01087 2 889161 le-01 , 
-6. 2963 51 23 117 2181 e-01 , 
3 . 715234 366137 601e-01 , 
-1.779572331145785e-01 , 
7 . 113143215820728e-02, 
-2. 4 03 37 826447 6541 e-02, 
6 . 879198166074 04 6e-03 , 
-1. 656 190902 5 1414 9e-03 , 
3 .302644 120224 97 le-04 , 
-5. 3 32055003 5187 4 7e-05, 
6. 764 4 47 617 54 7078 e-0 6, 
-6. 4 961 14 3 58 14 854 8e-07 , 
4 . 502 381 161607 562e-08 , 
-2 . 09903 3 629117 875e-09, 
5. 7 059 13 27 0502 097 e-11, 
-4 .936196094 1247 3 9e-13 , 
-1.463168035258393e-14 , 
3.339921369161159e-16, 
-1 . 652969295184 519e-18 , 
4 . 511432668l57739e-20, 
1. 6 18 4 97 00 6 3 67 0 2 3e- 31 , 
2.913303838345982e-03, 
-1 . 8 59587 1626274 63e-03 , 
-7. 257319744519464e-02, 
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3. 655964413534321e-01, 
-9. 60636l329579727e-01 , 
1. 6938273224886876+00, 
-2 . 1828393359645596+00, 
2 . 12853397?768278e+00, 
-1 .58724 664 94 5023 6e+00, 
8. 98694 6032 31 632 5e-01, 
-3 . 730810625463050e-01 , 
9 .989694 9964 9753 3e- 02 , 
-4 . 97 03 2 66972 6 4 04 9e-0 3, 
-1.160762684818817e-02, 
7 .783152259177362e-03, 
-3.2557528586436856-03, 
1 . 045405054255093e-03 , 
-2 . 683453425099142e-04 , 
5 . 4 32548388124 3 16e-05, 
-8. 285696168148078e-06, 
8. 7 7874 86193 2324 8e-07 , 
-5 . 498966408340436e-08, 
1 . 047635489968687e-09, 
9. 124468024653338e-ll , 
-5 .97 56 1927 6082 55 Oe-1 2 , 
1 .06987 102 2 603 523 e-1 3, 
-3 . 50737597 1593066e-16, 
1.2114408936 63 40 3e-17, 
2 . 074970670899496e-20, 
1 . 4 964 2 85 14 2 4 892 le-3 3 , 
4 . 94 39060404 69592 e-02 , 
-2 . 4 8665984 7 1972 88e-01 , 
4 .696527405284456e-01, 
-1 . 7 103 84 84 3 4612 70e- 01 , 
-1. 08653 4 6232 5l680e+00, 
2 . 936298628985867e+00, 
-4 .3 5595 3 3 52 92 322 3e+00, 
4 . 58 174 09877602 4 2e+00, 
-3 .7056624 4 282 554 2e+00, 
2 . 3 99924 94 0838602 e+00, 
-1. 2769385384 602 57e+00, 
5.681969684923196e-01, 
-2 . 137895 54 04 65093e-01 , 
6. 82 4 3 809 85 1077 14 e-02 , 
-1.836615026668542e-02, 
4 . 094 69908162 5 13 le-0 3 , 
-7 . 327299957345171e-04 , 
9 .96615354 8749 378e-05, 
-9. 192870090060862e-06, 
3 . 6389803 5561 9 663e-07 , 
3 . 81 140384804 33 70e-08, 
-8 . 162814 69914 033 8e-09 , 
7 . 5 14 3 84 7 87 1 62 9 9 le- 10, 
-4 . 201909270278608e-ll, 
1 . 4 27936059062 508e-l 2 , 
-2 . 6892 02 64 6 566 66 6e- 14 , 
2.6459841745513366-16, 
-2. 49926 69 47496 52 le- 18, 
1. 613 6839121 627 87e-20, 
1 . 10594 5879965577e-31 
>; 



/* Denominator coefficients */ 



static double denl[30]= 

{ -8 . 7 02 57 3 3 79 18 0253 e + 00, 

3 . 624 18505497 1434e+01 , 

~9 . 637476611139380e+01 , 

1. 840944567247478 e+ 02, 

-2 . 6919 32874 9 66105e + 02 , 

3. 133425 587 02 2512 e + 02, 

-2 . 979853544 5379 00e + 02 , 

2. 358162965122712 e+ 02, 

-1. 57 4 53 532 2 51 508 8e + 02 , 

8. 9 67 59 02 02 531342 e + 01, 

-4 . 395124 64 849884 9e+01, 

1. 8662 510649972 56e+01 , 

-6. 894463299309602e+00, 

2 . 218 00464423043 8e+00, 

-6. 19473602465194 le-01, 

1 . 490902 3 924 8257 6e-01 , 

-3. 0558086631l9203e-02 , 

5. 2 5050 112 059587 4 e-03, 

-7 . 417915268847094e-04 , 

8 . 426982161281500e-05, 

-7 .509 2 27 9 2 67 4024 8e-06, 

5. 10544 1468225222e-07 , 

-2 . 559 00 1 82 09 30 59 2e- 08, 

8 . 98 1854 29399 I370e- 10, 

-2. 02442287 62 992 69e- 11, 

2 . 556068754189784e-13, 

-1 . 85839108368694 5e-15, 

2 . 070784849258401e-17 , 

-5. 231469022776601e-21 , 

-8 . 2 0 3 8 2 8 57 9 08 7 64 3e-3 8 

} ; 



/* Does not apply 
static double num2 
static double den2 



for the case 1 * 
[ 1 ] [ 1 ] [ 1 )= { 1 . 0 } 
[ 1 ]={ 1 . 0 }; 



/ 
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/**************************************************************************** 



* 11 april 1991 * 

* transfer30lira.txt (Limited case ) * 

* Header file for transfer function variables * 

* Sampling time 0.02 sec * 

* CAPT D. Bertrand * 



it***************************************************************************/ 

/* Define the case / */ 

/define c 2 /* X-29, 30 states closed-loop conf. (limited case)*/ 



/* Define the variables 


*/ 




/* Level 1 */ 
/define ordl 


30 


/* 


order of the X-29 closed-loop conf. */ 


/define num_in 


2 


/* 


number of inputs to the X-29 closed-loop conf.*/ 


/define reg_vecl 


120 


/* 


regression vector =ord* (num_in+num_out) */ 


/define num_feed 


118 


/* 


feedback layer =reg_vec-num_in */ 


/define num comd 


120 


/* 


command layer = reg vec */ 


/define num_cont 


120 


/* 


control layer = regjvec */ 


/define nura_out 


2 


/* 


output layer = num out */ 


/* Level 2 


( not 


required ) */ 


/define ord2 


1 


/* 


order of the X-29 inverse closed-loop conf.*/ 


/define nura_in2 


1 


/* 


number of inputs to the X-29 inverse closed-loop 


/define reg_vec2 


1 


/* 


regression vector =ord* (num_in+num_out ) */ 


/define num_feed2 


1 


/* 


feedback2 layer = reg_vec-num_out */ 


/define num_comd2 


1 


/* 


command2 layer= reg_vec */ 


/define num_cont2 


1 


/* 


control2 layer = regjvec */ 


/define num out2 


1 


/* 


output2 layer = num in */ 



/* Declarations */ 



static 

static 

static 

static 



double ts={0.02) 
double alphal={l 
double alpha2={0 
double alpha3={0 



0 }; 
01 } ; 
001 } ; 



static char 
M A Pulse 



*input_name [ ]={ "Illegal 
input of 1 degree for 1 



Input" , "Random Binary" , 
sec (input 1)"," (input 2)"}; 



static char *state_name []={ "II legal 
"q ( t ) ", "theta (t ) "} ; 



State" , "u (t ) " , "alpha (t) " , 



/* Numerator coefficients of the X-29 closed-loop conf. */ 
/* Order is al-a30 & ql-q30 for the indices */ 



static double numl [ 2 ] [ 2 J [ 30 ] = 

{ 2. 844220109210482e-05, 

-4 . 63634 34904 60604 e-05, 

-4 . 816337071247290e-04 , 

2 . 54 19653521794 32e-03, 
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-6.221344563186904e-03 , 
9. 70083 69 0640422 Oe-O 3, 
-1.056937401995128e-02, 
8 . 128 09 8 8270 0094 Oe-O 3 , 
-3 . 97904 5497317202e-03, 
4 . 55014 727 890557 0e-04 , 
1 . 23 3 24 9102 824 63 0e-03 # 
-1 . 384 40382704 6299e-03 , 
9 . 04 002 4 8 002 708 8 5e-04 , 
-4 .324 73983984 4 938e-04 , 
1. 61587 1994 14 7 2 55e-04 , 
-4 . 804316744344561e-05, 
1.1228248251171646-05, 
-1 . 943751086891377e-06, 
2. 022 62 9447609 448 e- 07, 
3 . 408939495269658e-09, 
-5. 704 02 07 8 4 89077 5e-09, 
1. 058982467l33109e-09, 
-9 . 7002693504 981 15e-ll, 
3 . 954 993 5509559 55e- 12 , 
1 . 5562 57997 037 185e- 14 , 
-6. 3 16655529 3663 55e-15, 
1.434341976227709e-16, 
-5. 2848110984 161 18e-19, 
1 . 694 66313 2378100e-20, 
2. 2804 314 60264726e-26, 
1 . 302 8 67 2 542 58 54 4e-03 , 
-7 . 3828514 3050632 le-03 , 
1. 133243132534290e-02, 
2 .624 4 3618 4 0667816-02 , 
-1.598754 57881 52 60e-01, 
3 . 871527027772572e-01 , 
-6. 1121694 4 1003 06 le-01 , 
7 , 10294849l758525e-01, 
-6. 4 2 017 90012 612 04 e-01 , 
4 .654 7734 802 2 4 32 le-01, 
-2.756585281389334e-01, 
1 . 3 4 59004 53700608e-01 , 
-5. 4 2 22950012 274 4 0e-02 , 
1 .7832 626 19678 538e-02, 
-4 . 631680402436444e-03 , 
8. 6 1702901 63 689 60e-04 , 
-6. 9 508 53 8 500 5178 6e-0 5, 
-2 . 247015885420423e-05, 
1 . 2 054 64 699 6564 89e-0 5, 
-3 . 218 59007 7 39 6812e-0 6, 
5. 91 3 53 90124 6397 le-07, 
-7. 84 4 5774 6 17 3 1442 e-08, 
7. 4 21834 5116328 13e-09, 
-4 . 8l5724560938900e-10, 
2 . 020594 28980 12 37e-l 1 , 
-5. 015798784974 100e-13, 
6.438926158022875e-15, 
-4. 59547349128 094 Oe-17, 
5 .50233814 82 2264 9e-19 , 
1 . 714 4 6758894 94 88e-2 4 , 
3 . 414771400578331e-05, 
-1.114930428 08 774 6e-04, 
-1.84 113424 5808007e-04 , 
1. 854 6874 59513 116e-03 , 
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-5. 58 6092 87134 004 3e-0 3 , 
1.0649624 76698 3 8 3e-02, 
-1.499862810806007G-02 , 
1 . 6489274 2957 3632G-02 , 
-1. 4 3613 81592834 7 3e-02 , 
9 . 8 663968 10934 93 0g-03, 
-5 . 2 58 2 033 78 5029 13 G- 03, 
2. 09 2 8 2 129 19 67 084 G- 03, 
-5. 565361 1724 4377 2g-04 , 
4 . 80782 558 51 1805 3e-05, 
4 . 066271 01270 37 37G-05, 
-2 .719419553098845e-05, 
1 .03 3 1563624 3994 6g-05, 
-2 .955581602 3 4854 5e-06, 
6.870538006159554e-07, 
-1. 3 169 394 1515798 1g-07, 
2 . 026221445272300e-08 , 
-2 . 361233864 223 112g-09 , 
1.921 063600537 676g- 10, 
-9. 8 09 951 61 1347394 G- 12, 
2 . 653279103876279G-13, 
-2 . 3 192 33 372 88 078 2g-1 5, 
-1. 31718706l896219e-17, 
-2 . 4 07012 53589 171 1g-19, 
-4 . 43 38801182 58 184 e-21 , 
2 . 7359035050224 65g-2 6 , 
1 . 596981542963505g-03, 
-8 . 528373703732939G-03, 
1. 08 619 610674 62 29g-02, 
3. 8468975642 67 238 g-02, 
-1 .9767 3093 55052 02g-01, 
4 . 554354535725906G-01 , 
-7. 004 5724 10351 102G-01 , 
8 . 039373333258482G-01, 
-7 . 25627293105390 0e -01, 
5. 302621924158757e-01, 
-3. 18914 66144 38982e-01, 
1 . 59 05139 028 632 2 2 e- 01 , 
-6. 5733010848674 67e-02 , 
2 . 225901012 112530G-02 , 
-5. 9889 500294 20792G-03, 
1. 17784 24 78515601G-03, 
-1. 182446502181467G-04 , 
-2 . 0784 5664 9373672G-05, 
1 . 3692322 38 67 6577G-05, 
-3 . 80195376972064 5g-06, 
7 .081334 3 52 697 58 3g-07, 
-9.4376385026244 14 g-08 , 
8 . 9 367 667 59 59 1824 g- 09 , 
-5. 7 94 705377 00014 6e-10, 
2 .428464299936500G-11, 
-6. 021234370560187G-13, 
7 .724462474 106624 g-15, 
-5. 5 1667 19 524 188 55g- 17, 
6. 595904 19 13 5968 6e- 19, 
2 . 056900519 28 2 188G-24 
}? 



/* Denominator coefficients */ 



static 

6 

-2 

4 

-8 

1 

-1 

1 

-1 

8 

-4 

2 

-1 

4 

-1 

4 

-1 

2 

-4 

6 

-8 

8 

-6 

3 

-I 

2 

-3 

2 

-2 

1 



double denl[30]= 

{ -1. 135087 14 65561 6le+01, 

093263 249866681e+01, 
06191106582222 2e+02 , 
94803513273 1752e+02 , 
983923725483406e+02 , 
286089683 0003 5 5e+03 , 
493744793706265e+03 , 
437421369904793e+03, 
16429688962 0834e+03 , 

034 3 80606787 025e+02 , 

7 6652 1786713 29 3e+02 , 
447238944329588e+02 , 

0920864 4 2 202 8 05e + 02 , 
244916189022602e+01, 
437006104677 7 57e+01 , 
225905264868553e+00, 
073931722819647e+00, 
338884065807147e-01 , 
313167043461474e-02 f 
624455192814 090e-03 , 
286628884990565e-04 , 
195010027770559e-05, 
160373942002916e-06, 

3 4 54 169 3 07 7 07 29 e-07 , 

22792 16814 8 63 61e- 08 , 

77 54 7 58 01 8 3 0879 e-10, 

4 102 8717 01 88 014 e-1 2 , 
5178955542 15908e-14 , 
74218529250783 ie-16, 
2761074284207359-33 
} ; 



/* Does not apply 
static double num2 
static double den2 



for the case 
[ 1 ] [ 1 ] [ 1 ]= {1 
[ 1 ] = { 1 . 0 } ; 



1 * 

. 0 } 



/ 
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y**************************************************************************** 



* 11 april 1991 * 

* transferhplinv.txt (Optimal case input 1) * 

* Header file for transfer function variables * 

* Sampling time 0.02 sec * 

* CAPT D. Bertrand * 



****************************************************************************/ 
/* Define the case / */ 

/define c 3 /* X-29 inverse closed-loop conf. structure */ 



/* Define the variables */ 



/* Level 
/define 


1 */ 
ordl 


30 


/define 


num_in 


1 


/define 


reg_vecl 


90 


/define 


num feed 


89 


/define 


num_comd 


90 


/def ine 


num cont 


90 


/define 


num out 


2 



/* order of the X-29 closed-loop conf. */ 

/* number of inputs to the X-29 closed-loop conf.*/ 
/* regression vector =ord* (num_in+num_out) */ 

/* feedback layer =reg_vec-num_in */ 

/* command layer = reg_vec */ 

/* control layer = reg_vec */ 

/* output layer = num_out */ 



/* Level 2 */ 

/define ord2 30 
/define num_in2 2 
/define reg_vec2 90 
/define num_feed2 88 
/define num_comd2 90 
/define num_cont2 90 
/define num out2 1 



/* order of the X-29 inverse closed-loop conf.*/ 

/* number of inputs to the X-29 inverse closed-loop*/ 
/* regression vector =ord* ( num_in+num_out) */ 

/* feedback2 layer = reg_vec-num_out */ 

/* command2 layer= reg_vec */ 

/* control2 layer = reg vec */ 

/* output 2 layer = num_Tn */ 



/* Declarations */ 

static double ts={0.02}; 
static double a lpha 1= { 1 . 0 } ; 
static double alpha2={ 0 . 01 } ; 
static double a lpha3= { 0 . 001 } ; 

static char * input_name [ ]={"I 1 legal Input” , "Random Binary”, 

”A Pulse input of 1 degree for 1 sec (input 1)”,” (input 2)”}; 



static char *state_name [ ]={" Illegal State” , ”u (t) ”, ”alpha (t) " , 
”q ( t ) ” , ”theta ( t ) ” } ; 



/* Numerator coefficients of the X-29 closed-loop conf. */ 
/* Order is al-a30 & ql-q30 for the indices */ 

static double numl [ 1] [ 2 ] [ 30]- 

{ 7.21794 17901239 16e-03 , 

4 . 136127382910360e-02, 

-4 .6697 68 97 4 8 593 52 e-01, 

1 .74 09 15378 9 1078 5e+00, 

-3 . 86097 2 0794 90637e+00, 



160 



5. 9 10026 00 1863514 e + 00, 
6. 603623724905617 e + 00, 
5. 4 6 18 1 519 17 3 5 52 5e + 00, 
3 . 270158987514236e+00, 
1 . 276667299 594 39 4 e+00, 
1.520754074600887e-01, 
2 . 051159049792766e-01, 
1. 94 53 4 555613 52 8 5e-01 , 
1 . 056009840779120e-01, 
4 . 3050248 16802 305e-02 , 
1 . 4 2 1564 4 2 51 60682e-02 , 
3.890465813729260e-03 , 
8.753878576499303e-04 , 
1. 567504967623089e-04 , 
2 . 108457015082093e-05, 
1 .9 254 19 09592 384 0e-06, 

9 . 2 7653 9 50132 139 0e-0 8 , 
7 . 82269218911 6 382e-10, 
3 . 6066584558301456-10, 
1.731282437642258e-ll, 
2. 82883 02 23439087 e-13, 
1. 035513245405491e-15, 
3 . 084625475376078e-17 , 
6. 08 7 62 9 1104 6329 3e-20, 
2 . 18 8724 96803 13 3 5e-3 3 , 

3 .03 02 7 9064 2 4 802 0e-02, 
2. 176617 363311379e-01, 
7 . 199418522371559e-01, 

1 . 4 4 58 874 688 3 124 5e + 00, 
1 . 937 23 2 4 3 87 53 2 5 6e+00, 
1.744010 58 513 98 47 e+00, 
9. 046191030770956e-01 , 
7 . 52 0983 8 38 9071 14 e-0 2 , 
6. 9429 19 4406558 28 e-01, 
8. 18 010872889161 le-01, 
6. 29635123 1172 18 le-01 , 
3 .7152 343 66137601e-01, 
1.779572 3 3 114 5785e-01, 
7 . 113143215820728e-02 , 
2. 4033782 64 476 54 le-0 2, 
6. 87919816607404 6e -03, 
1. 656190902 514 14 9e-03 , 

3 . 3 02 64 4 12 02 2 4 97 le-04 , 
5. 3 32 05500 3 51874 7e-05, 
6. 764 44 7 617 547 078e-06, 
6. 4 96114 3 58 14 8 54 8e-07 , 
4 . 502 38 1 161607 5 62e-08, 
2 .09903 3 62 9 117 87 5e-09, 
5.705913270502097e-ll, 
4 .93 6 196094 12 473 9e-l 3 , 
1.4 63 16803 52 58 3 9 3e-14 , 
3 . 3 3992 13 691 611 59e-16, 
1 . 652969295184 5 19e- 18 , 
4. 51 14 326 68 157 739e- 20, 
1. 6 18 4 97 0063 67 02 3e- 31 

} ; 
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/* Denominator coefficients */ 
static double denl[30]= 



{ -8 . 702573379180253e+00, 

3. 62418 5054971434 e+01, 

-9. 637476611139380e+01 f 
1 . 840944567247478e+02, 

-2 . 691932874966105e+02, 

3. 133425587022512e+02 , 

-*2 . 979853544537900e + 02 , 

2 . 3581629651227 12e+02 , 

-1. 574535322515088e+02, 

8 . 967590202531342e+01 , 

-4 . 395124648498849e+01, 

1 . 866251064997256e+01, 

-6. 894463299309602e+00, 

2 . 218004644230438e+00, 

-6. 19473602465194 le-01, 

1. 490902392482576e-01 # 

-3 .055808663119203e-02, 

5. 2 50501 12 0595874 e-03 , 

-7. 4 179 152 6884 709 4e-04 , 

8 . 426982161281500e-05, 

-7 . 509 2 2 792 67 4 02 4 8e-0 6, 

5. 105441468225222e-07 , 

-2. 559 00182093 0592e-08, 

8 .98 1854 29 399 137 0e- 10, 

-2 . 024422876299269e-ll, 

2 . 556068754 18 97 8 4e- 13 , 

-1. 85839108368694 5e-15, 

2. 07 07 8484925840 le- 17, 

-5. 231469022776601e-21 , 

-8 . 2 03 82857 908 764 3e-3 8 

} ; 



/* Does not apply for 
static double num2[2][ 
static double den2[30] 



the inverse plant 
1 ] [ 30 ]= { 1 . 0 }; 
-{ 1 * 0 } ; 



*/ 
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/**************************************************************************** 

* 6 Sept 1991 * 

* transferA4inv.txt * 

* Header file for transfer function variables * 

* Sampling time 0.1 sec * 

* Capt D. Bertrand * 

****************************************************************************/ 



/* Define the case / */ 

/define c 4 / * A4 inverse plant structure */ 



/* Define the variables */ 



/* Level 1 */ 

/define ordl 4 
/define num_in 1 
/define reg_vecl 20 
/define num_feed 19 
/define num_comd 20 
/define num_cont 20 
/define num out 4 



/* order of the A4 plant */ 

/* number of inputs to the A4 plant */ 

/* regression vector =ord* (num_in+num_out ) */ 
/* feedback layer =reg_vec-num_in */ 

/* command layer = reg_vec */ 

/* control layer = reg_vec */ 

/* output layer = num_out */ 



/* Level 2 */ 

/define ord2 4 
/define num_in2 4 
/define reg_vec2 20 
/define num__feed2 16 
/define num__comd2 20 
/define num_cont2 20 
/define num out2 1 



/* order of the A4 inverse plant */ 

/* number of inputs to the A4 inverse plant */ 
/* regression vector =ord* (num_in+num_out ) */ 
/* feedback2 layer = reg_vec-num_out */ 

/* command2 layer= reg_vec */ 

/* control2 layer = reg vec */ 

/* output 2 layer = num_Tn */ 



/* Declarations */ 

static double ts={0.1}; 
static double alphal={ 1 . 0} ; 
static double alpha2={ 1 . 0 } ; 
static double alpha3={ 0.001}; 



static char *input_name []={ "II legal Input" , "Random Binary", 

"A Pulse input of 1 degree for 1 sec (input 1) ","( input 2)"}; 



static char *state_name [ ] ={ "I llegal State" , "u (t) ", "alpha (t) " , 
"q ( t ) " , "theta ( t) " } ; 



/* Numerator coefficients for the A4 plant*/ 

/* Order is ul-u4 , al-a4 f ql-q4 & tl-t4 for the indices */ 

static double numl [ 1 ] [ 4 ] [ 4 ] = 

{ 

2 . 7 13 0682 100917 62e-05 f 
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7 . 72 4 7 59 7 56 8 3306 6e-0 5, 

-7 . 0557 911 008961 58e-05, 
-2.2579374415077076-05, 

-3 .4 6192 8 651 2664 44 e-02, 

4 . 5022 358 17 67907 9e-02 , 

1. 3 7 15 112 59 67 118 8 e-02 , 
-2.412412258081098e-02 , 

-1. 98 64 4 97 634 9737 8e-01, 

5. 8 00247 57 8329634 e- 01, 

-5. 64136690842774 le-01, 

1.8 27 569093 59 54 8 4 e-01, 

-7 .705180437452608e-03 , 

7 .47812 4 8724 34 93 3e-03 , 

6. 9 64 0104 111017 2 9e-03 , 
-6.738625984288427e-03 
} ; 

/* Denominator coefficients for the A4 plant */ 

static double denl[4]= 

{ 

-3 . 694 92 3 64 3 8 54 82 2e+ 00, 

5. 18 02 17 3 04 7 54 8 2 8e+00, 

-3 .27 54 997 3564 820 le+00, 

7. 9 02 1486125 67 799e-01 

} ; 



/* Does not apply for the 
static double num2 [ 4 ] [ 1] [ 4 
static double den2[4]={0.0 



inverse plant 
]® { 0 . 0 }; 

} ; 



*/ 
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/**************************************************************************** 



* 28 july 1991 * 

* transferl4inv.txt * 

* Header file for transfer function variables * 

* Sampling time 0.02 sec * 

* CAPT D. Bertrand * 

* * 



****************************************************************************/ 

/* Define the case / */ 

/define c 5 /* X-29 Inverse plant structure */ 



/* Define the variables */ 



/* Level 
/define 


1 */ 
ordl 


14 


/define 


num_in 


1 


/def ine 


reg_vecl 


42 


/define 


num_f eed 


41 


/define 


num comd 


42 


/define 


num_cont 


42 


/define 


num out 


2 



/* order of the X-29 Plant */ 

/* number of inputs to the X-29 Plant */ 

/* regression vector =ordl*(num in+num_out) */ 
/* feedback layer =reg_vec-num_In */ 

/* command layer = reg_vec */ 

/* control layer = reg_vec */ 

/* output layer = num_out */ 



/* Level 2 */ 

/define ord2 14 
/define num_in2 2 
/define reg_vec2 42 
/define num_feed2 40 
/define num_comd2 42 
/define num_cont2 42 
/define num out2 1 



/* order of the X-29 inverse plant */ 

/* number of inputs to the inverse plant */ 

/* regression vector =ord2* (num_in+num_out) */ 
/* feedback2 layer = reg_vec-num_out */ 

/* command2 layer= reg_vec */ 

/* control2 layer = reg vec */ 

/* output2 layer = num_Tn */ 



/* Declarations */ 

static double ts={0.02}; 
static double alphal={ 1 . 0} ; 
static double alpha2 = { 0 . 01 } ; 
static double alpha3 = { 0 . 001} ; 



static char *input_name []={ "Illegal Input" , "Random Binary", 

"A Pulse input of 1 degree for 1 sec (input 1)" ," (input 2)"}; 

static char *state_name []={ "Illegal State" , "alpha (t) " , 

"q(t)">; 



/* Numerator coefficients for the X-29 plant */ 



static double numl [ 1 ] [ 2 ] [ 14 ]= 

{ -4 . 056931727527413e-04 , 

8 . 64 09858012 35956e-04 , 

-9 . 64 5374 7784 153 17e-04 , 
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7 . 668732 134 167 300e-04 , 
-3 . 355203324524325e-04 , 
2. 00298860011383 le-05, 
4. 4238998 44 69 659 9e-05, 
-2.134656278755809e-05, 
4. 206573 55632 18 83e-06, 
-2.414898471374619e-07, 
3. 9 3 554 158 63 7 903 8e-09, 
-1. 29 67894 2 3 14 6734 e-09, 
6.012915966444080e-ll, 
6. 139928164 0967 63e- 13, 
-1 .468836867932399e-02 , 
5. 0672 39 04 4 67 04 8 0e-02 , 
-8 . 185463286921646e-02 , 
8 . 3512058 550237 36e-02 , 
-5.856919312782694e-02 , 
2.927929467703660e-02, 
-1.08 2 64 87659 44 08 3e-02, 
2. 9 508 04 3 9 93 057 7 Oe- 03, 
-5. 601 5663 87 11 1508 e-04 , 
6. 63 19582 14 7 3863 0e-05, 
-2. 0503 37 74889 52 4 0e-06, 
-1. 175920855414365e-07, 
4.286644733642849e-09, 
6. 95398 5652 098497e-ll 
} ; 



/* Denominator coefficients for the plant */ 

static double denl[14J= 

{ -4.729739487O34623e+O0, 

9 . 756583616420810e+00, 

-1. 169645031172698e+01, 

9 . 179964647228649e+00, 

-5. 02 5697 4 2 02 037 6 le+00, 

1.9789 13 68 3 674 68 6e+00, 

-5. 63 08387279949 58e-01, 

1.13748 07 68724702e-01, 

-1. 554252095215423e-02 , 

1.30029694 28 34 3 50e-03, 
-5.737414053144769e-05, 

1. 0554 3 8 67 98 8613 0e-06, 

-4 . 924 50056237 3 306e-09, 

1 . 1 14 7 62 0008 08 64 4 e- 10 

} ; 



/* Does not apply for 
static double num2[2] 
static double den2[14 



the inverse plant 
[1][14]= {1.0}; 

]={ 1 . 0 } ; 



*/ 



166 



/**************************************************************************** 



* 28 july 1991 * 

* transferl614hp.txt OPTIMAL CASE * 

* Header file for transfer function variables * 

* Sampling time 0.02 sec * 

* CAPT D. Bertrand * 

* * 



****************************************************************************/ 



/* Define the case / */ 

/define c 6 /* controller and plant in series (optimal case) */ 



/* Define the variables */ 
/* Level 1 */ 



/def ine 


ordl 




16 


/* 


order of the controller */ 


/define 


num_ 


in 


2 


/* 


number of inputs to the controller */ 


/define 


reg_ 


vecl 


64 


/* 


regression vector =ordl* (num in+num_out) 


/define 


num_ 


feed 


62 


/* 


feedback layer =reg vec-num Tn */ 


/define 


num_ 


comd 


64 


/* 


command layer = reg_vec */ 


/define 


num_ 


cont 


64 


/* 


control layer = reg_vec */ 


/define 


num_ 


out 


2 


/* 


output layer = num_out */ 


/* Level 


. 2 * 


/ 








/define 


ord2 




14 


/* 


order of the plant */ 


/define 


num_ 


in2 


2 


/* 


number of inputs to the plant */ 


/define 


reg 


vec2 


56 


/* 


regression vector =ord2*(num in+num out) 


/define 


num_ 


f eed2 


54 


/* 


feedback2 layer = reg^vec-num out */ 


/define 


num 


comd 2 


56 


/* 


command2 layer= reg vec */ 


/define 


num 


cont2 


56 


/* 


control2 layer = reg_vec */ 


/define 


num_ 


out2 


2 


/* 


output2 layer = num in */ 



/* Declarations */ 



static double 
static double 
static double 
static double 



ts={0. 02} ; 
alphal«{1.0> ? 
alpha2={ 1.0}; 
alpha3={0 . 001} ; 



static char 
"A Pulse 



*input__name [] = { "Illegal Input", "Random Binary", 
input of 1 degree for 1 sec (input 1)"," (input 2)"}; 



static char *state_name [ ]={" Illegal State" 
M q(t) "} ? 



"alpha (t ) ", 



/* Numerator coefficients for the controller */ 



static double numl [ 2 ) [ 2 ] [ 16 ] = 

{ -9. 859880629593550e+01, 

4 . 65187313814 6647e+02 , 

-1 . 051882 1057 3088 le + 03 , 
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1 . 519154936044425e+03 , 
-1 . 5 57 9 6 57 3 8 2 84 664 e + 03 , 
1. 21104 2887906508e + 03, 
-7. 4967 09 549954828 e+02 , 
3 .74 4 973 73 664 363 9e+02, 
-1 .4 7854 1553785084 e+02 , 
4. 4664 34156470294 e + 01, 
-1 .003081522244 191e+01 , 
1. 620404514735607e+00, 
-1.7427985729228796-01, 
9.724575442910928e-03, 
-2 . 035547071170431e-04 , 
8. 74 538807 37 3 62 3 5e-l 3, 
-4 . 388188326607877e+01, 
-4 . 616177234 4 68 056e+01, 
6. 39211114 5682 509e+02, 
-1 . 3974 4 8977654 54 2e+03, 
1.523 8678 104 94 3 3 5e+03, 
-9 .9 79 62 057 5051 4 04 e+02 , 
4 . 152396606507909e+02 , 
-1 . 06147851703 6687e+02 , 
1 . 2 69 59 8 9 03 99 9 64 7e+ 01 , 
1 . 194 08053 574 03 61e+00, 
-7 . 05554 95581864 06e- 01 , 
1 .05628 36 167038 4 9e-01, 
-6. 324466886079779e-03 , 
7 . 0964 6337770584 7e-05, 
3 . 2811638264 3 3 534 e-06, 
3 .825564 6255654 15e-ll , 
3 . 792362230268161e+01 , 
-1 . 8032181874 4418 6e+02 , 
3 . 8099354 05874 783e+02 , 
-4. 826993636192602 e+02, 
4 . 09164 1992932675e+02 , 
-2. 334 4 4 618 1168 790e+ 02 , 
7 .988 6658 878 6833 8e+01, 
-7 . 02 8 001 8 65 3 07 54 4 e+00, 
-8 . 3 038 4 76298062 90e+00, 
5 . 21274 07207611 16e+00, 
-1 . 69780680224 9656e+00, 
3 .603723 294 285617e-01, 
-4 . 8731934 05327581e-02 , 
3 . 115239986192253e-03 , 
-7 . 05224 887 0239583e-05, 
5. 975861393 289898e-13 , 
-2.244300433086851e+01, 
6. 3811384 11559539e+01, 
-1 . 29606264 144 0044 e+01 , 
-1 . 732261722889801e+02 , 
3 . 201844 27 503 0160e+02, 
-2. 8774 8664 52384 89e+02, 
1. 55397 08 089 197 18 e+02, 
-5. 26363280484 1900e+01 , 
1 . 052424851243618e+01, 
-8 . 05222968 185982 6e-01 , 
-1. 294834 168 32 254 8e-01, 
3 .491001117314470e-02, 
-2 . 621648845901227e-03, 
4 . 36967504 709747 8e-05, 
1.084 7036809 18890e-06, 



2 . 614 06855355772 2e-ll 
} ; 



/* Denominator coefficients for the controller */ 



static 

7 
-9 

8 
-5 

2 

-9 

3 

-7 

1 

-2 

1 

-9 

1 

-4 

-3 



double denl[16]= 

{ -4 . 134 1127630674 15e+00, 

952036535343285e+00, 

67922 24 66663 568e+00, 
264755004 l39751e+00, 

1564 72 0502 476 17e+00, 
466202573916116e+00, 
52665174 254 34 44e-01 , 
043804172191035e-01 , 
8094502734 38016e-02 , 

5076574 094 3 1068e-02 , 

0 62 878392003 597e- 03, 
878287444794598e-04 , 
2672ll620365389e-06, 
776861871651543e-07, 
6929025094 27273e-ll , 
103818469371239e-28 
} ; 



/* Numerator coefficients for the plant */ 



static double num2 [ 2 ] [ 2 ] [ 14 ] = 

{ -3 . 58526308064 0999e-05, 

-2 . 77780745054 9119e-05, 
4.539524991091781e-04, 

-5. 958420322347280e-04 , 
2.664995123886627e-04 , 

-5. 610107617126658e-06, 

-4 . 1884 69924 792 9 3 7e-0 5, 
1.8570953 02063 017e-05, 

-3 .4 54 0004 72 3 8597 6e-0 6, 

2. 192568109666768e-07, 

3 . 8195568332 1876le-09, 

-4 . 2 688544 2959 0967e-10, 

-2 . 6551 107 14 86024 0e-l 3, 

-5 . 118 954 168 08887 3e-14 , 

-7. 513347186476338e-04 , 

8 . 561991155699999e-03, 

-1. 277978 8 559 3228 2e-02, 

1 . 1814 762 792 65681e-03, 

8 . 878987005693 3 4 0e-03 , 

-7 .4 8601 0702 82 783 9e-0 3 , 

2 .98 893 8 38 158753 6e-03, 

-6. 4 184789044964 55e-04, 

5. 74 2794875096026e-05, 

1. 3 8 19 4 0 02 99 058 64 e-0 6, 

-4 . 971836625593487e-07, 

1. 80132 3508010827e-08 , 

-2. 8 14 17037 3 92 608 5e-ll , 

2 .08 3 9 60 04 4 2 77704 e-1 2, 

-4 . 0569317275274 13e-04 , 

8. 640985801235956e-04 , 

-9. 645374778415317e-04 , 

7. 668732134 167300e-04 , 
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-3 . 355203324524325e-04 , 
2 .002 988 6001 1383 le-05, 
4 .4 2389 9 84 4 69 6599e-05, 
-2 . 13 4 65627 87558 09e-05, 
4 .20657 3 55632 188 3e-06, 
-2 . 4 1489847 1374 619e-07 , 
3 . 93554 158 6 3790 3 8e- 09 , 
-1. 2 9 67 894 23 14 67 3 4 e-09 , 
6. 0129159 664 4 4 080e-ll, 
6. 13 99 2 8 164 09 676 3e- 13 , 
-1. 4688368 67 932399e-02, 
5 . 067239044 6704 80e-02 , 
-8 . 1854 63 2 869 2 16 4 6e-0 2 , 
8 . 3 51205855023 73 6e-02 , 
-5. 8569 19 3 1278269 4e-02 , 
2 . 9279 29 4 677 0 3 660e-02 , 
-1. 08 2 64 87 6 59 4 4083 e- 02 , 
2.950804399305770e-03 # 
-5. 6015663 87 111508e-04 , 
6. 631958214738630e-05, 
-2. 0503 3774 889 52 4 0e-06, 
-1. 17 592 08554 143 65e-07, 
4 . 28 6644 733 64 2 849 e-09 , 
6. 9 539 85652 0984 97e- 11 
} ; 



/* Denominator coefficients for the plant */ 



static double den2[14]= 

{ -4 . 729739487 034623e+00, 
9 . 756583 616420810e+00, 

-1. 169645031172698e+01, 

9. 1799 64 64 722 8 64 9 e + 00, 

-5. 025697420203761e+00, 

1. 978913683674686e+00, 

-5. 63 083 87 2 799 4958 e-01 , 

1. 1374 8076872 4 7 02e- 01 , 

-1 . 554252095215423e-02 , 

1 . 3 0029 69 4 283 4 3 50e-03 , 

-5. 7 37 4 14 053 14 4769 e-05, 

1. 0554 3 8 67988613 0e-06, 

-4 . 9 24 500 562 37 3 306e-09 , 

1 . 114 7 62000 8 08 64 4 e-10 



} ; 
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/**************************************************************************** 



* 28 july 1991 * 

* transferl614lim.txt LIMITED CASE * 

* Header file for transfer function variables * 

* Sampling time 0.02 sec * 

* CAPT D. Bertrand * 

* * 



****************************************************************************/ 

/* Define the case / */ 

/define c 7 /* controller and plant in series (limited case) */ 



/* Define the variables */ 



/* Level 


1 * 


/ 




/def ine 


ordl 




16 


/def ine 


num_ 


in 


2 


/define 


reg 


vecl 


64 


/define 


num_ 


feed 


62 


/define 


num_ 


comd 


64 


/define 


num_ 


cont 


64 


/define 


num 


out 


2 



/* order of the controller */ 

/* number of inputs to the controller */ 

/* regression vector =ordl*(num in+num_out) */ 
/* feedback layer =reg__vec-num_Tn */ 

/* command layer = reg_vec */ 

/* control layer = reg_vec */ 

/* output layer = num_out */ 



/* Level 2 */ 

/define ord2 14 
/define num_in2 2 
/define reg_vec2 56 
/define num_feed2 54 
/define num_comd2 56 
/define num_cont2 56 
/define num out2 2 



/* order of the plant */ 

/* number of inputs to the plant */ 

/* regression vector =ord2* ( num_in+num_out ) */ 
/* feedback2 layer = reg_vec-num__out */ 

/* command2 layer= reg_vec */ 

/* control2 layer = reg vec */ 

/* output2 layer = num_In */ 



/* Declarations */ 

static double ts={0.02}; 
static double alphal={ 1 . 0 } ; 
static double a lpha2= { 1 . 0 } ; 
static double alpha3={0 . 001} ; 

static char *input_name []={ "Illegal Input", 

"A Pulse input of 1 degree for 1 sec (input 1 )","( input 2)"}; 

static char *state_name []={ "Illegal State" , "alpha (t) " , 

"q ( t ) " } ; 



/* Numerator coefficients for the controller */ 



static double numl [ 2 ] [ 2 ] [ 16 ]= 

{ -2. 479711140348080e-01, 

1 . 388 54 62 04 672132 e+00, 

-3 . 54 67724 05083 3 24 e+00, 
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5. 5655784 28 01 67 57e+00, 
6. 0958820900954446 + 00, 
4 .985447353467308e+00, 
3 . 14659911130174 06 + 00, 
1 . 5546756607724 8 3e+00, 
6.0599106459555776-01, 
1 . 8 64 04 7 6 524 59 634 e-01, 
4 .43707 4 5 09 219546e-02, 
7 . 7953547 57 026977e-03 , 
9 . 144 57 109942 12 36e-04 , 
5. 442429543013751e-05, 
1 . 2 053 7 60 3 50 6 0677 e-0 6, 
4 . 02 604 87 29 3 6017 4e- 10 , 
2. 613658394 640 9 16e-01 , 
1 . 180069353917421e+00, 
2. 158547648 3223 19e+00, 
1. 997245892440489e+00, 
8.979474879152747e-01, 
7. 149916375388088e-02 , 
1 . 1166093732793 3 le-01 , 
5. 08 3 5904 1654 271 6e-02, 
8 . 4 59759 671 103 129e-0 3 , 
2. 947 8 17 097 2 5078 2e-04 , 
1 . 181801294794 504e-04 , 
5 .27 09693 022 6962 6e-05, 
1. 4 64 61 58 3209 6148 e- 05, 
6. 312847660653519e-06, 
6. 0061352 3 4 34 397 3e-07 , 
1 . 681353315103645e-08 , 
2 . 536536100527425e-01 , 
1 . 564660964790082e+00, 
4. 3 60 350547653734 e+00, 
7 . 303031625580367e+00, 
8 . 252324911573620e+00, 
6. 69522 11 6898 5064 e+00, 
4 .052 659667 28 4 534 e+00, 
1 .8771826674 14 060e+00, 
6. 754625922866597e-01, 
1.891390637720 00 3e- 01, 
4 .0502259 1188 5580e-02, 
6. 3 38 009693 28947 3e-03, 
6. 54 5692 52 37 68 167 e-04 , 
3. 5377 24 4 662 11 512 e-05, 
7 . 202327 264979368e-07 , 
4 . 8301768520174 13e-10, 
3 . 48 33 0950099242 6e-01 , 
1 .78 34 289127 51852e+00, 
3 .81954 623 12 0383 0e+00, 
4 . 3 33227 159290 175e + 00, 
2. 566270736673481e+00, 
3. 51274153409498 5e-01, 
6. 441742008168490e-01 , 
5. 71333 5098 8250 08e -01 , 
2 . 5038421474 33657e-01 , 
6. 674 3508204 4 11 99e-02 , 
1 . 043571874877550e-02, 
6. 44615527 197 0164e-04 , 
6.960491892187438e-05, 
1 .575972011659112e-05, 
9. 8 3 564 08 4 79 502 3 4e-07 , 
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2. 017 17227201988 8e- 08 
} ; 

/* Denominator coefficients for the controller */ 

static double denl[16]= 

{ -6.6258032147241856+00, 

1.9874809463910116+01, 

-3 . 59 8l992 08 8 59 2 6 3e + 01 , 

4 .4329446l9799812e + 01, 

-3 .9799 190392 5684 0e+01, 

2. 7229516704744 20e+01, 
-1.4619911405588156+01, 

6. 267 9 2 158 4 7 3807 5e+00, 

-2 . l6025568l723939e+00, 

5. 94 7 802 3 17 87 554 7e-01, 

-1. 274 873 0200137 56e-01, 

2. 01752103 194 1172e-02, 

-2. 124031340776859e-03, 

1. 17 18 292 8 3 9558 4 2e- 04 , 
-2.459886242548657e-06, 

1. 3 53 8895901687 05e-2 2 , 

} ; 



/* Numerator coefficients for the plant */ 



static double num2 [ 2 ] [ 2 ] [ 14 ]= 
{ -3 . 5852 6308 064 0999e 

-2 . 777807450549119e-05, 

4 .53 9524 99 109 178 le-04 , 
-5. 958 4 2032234 728 0e-04 , 

2. 664 995 12 3 88 662 7e-04 , 
-5. 610107617 126658e-06, 

-4 . 188469924792937e-05, 

1. 857095302063017e-05, 
-3. 454000472385976e-06, 

2 . 192568 109666768e-07 , 

3 .81955683321876le-09 , 

-4 .268854 4 29590967e-10, 
-2. 655110714 8 6024 Oe- 13 , 
-5. 118954 168088 87 3e-14 , 

-7 . 513347 186476338e-04 , 

8 . 561991155699999e-03 , 
-1.277978855932282e-02, 

1. 18 14 7627926568 le-03 , 

8 . 87 8987 005693 3 4 Oe- 03 , 

-7 . 4 86010702827 83 9e-03 , 

2. 988 93 8 381587536e-03 , 
-6. 418478904496455e-04 , 

5. 7 4 2794 8 7 5096026e-05, 

1 . 38 19 4 002 99 05864 e-06, 

-4 . 9718 3 662 5593 4 8 7e-07 , 
1.80132 3 5080l0827e-08 , 

-2 .814170373926085e-ll, 

2 .08 39 6004 4 27 7704 e-12, 

-4 . 05693 17275274 13e-04 , 

8. 640985801235956e-04 , 
-9. 6453747784 153 17e-04 , 



05, 



173 



7 . 668732134167300e-04 , 
-3 . 355203324524325e-04 , 
2 . 00298860011383 le-05, 
4. 423899844696 59 9 e- 05, 
-2 . 134 65627 87 558 09e-05, 
4 . 2 06 57 3 5 563 2 1883 e-06, 
-2 . 4 1489847 13 7 4619 e-07 , 
3 . 93 554 1586379 038e-09 , 
-1. 29 67 8942314 67 34e- 09, 
6. 0129 1596644 4 080e-ll, 
6. I39928164096763e-13, 
-1. 468836867932399e-02, 
5 . 067 2 39 04 4 67 04 8 0e- 02 , 
-8. 1854 6328 692 164 6e-02, 
8 . 3512058 55023 7 3 6e-02 , 
-5. 8 569 19 3 127 8269 4e- 02, 
2 .927929467703660e-02 , 
-1. 082648765944083e-02 , 
2 . 950804 3993 0577 0e-03 , 
-5. 6015663 871 11508e-04, 
6. 63 19 582 147 3863 0e-05, 
-2 . 050337748895240e-06, 
-1. 1759208554 14 3 65e~07 , 
4 . 286644733642849e-09 , 
6. 953 985652 0984 97e-ll 
> ; 



/* Denominator coefficients for the plant */ 



static double den2[14]= 

{ -4 .729739487034623e+00, 
9 . 7 56583 616 4208 10e+00, 

-1. 169645031172698e+01, 

9 . l79964647228649e + 00, 

-5. 02 5697 4 2 02 0376 le+00, 
1.978913683674686e+00, 

-5. 63 08 3 87 2 7 99 4958 e-01, 

1. 1374807687247 02e-01, 

-1. 554 2520952 1542 3e-02, 

1. 3002 9 694 2 8343 50e- 03 , 
~5.737414053144769e~05, 

1. 0554 3 867 988 613 0e-06, 

-4 . 924500562373306e-09 , 

1. 1 147 62 00080864 4 e- 10 

} ; 



174 



APPENDIX D: MATLAB M-FILES 



% contdiscliml . m 
% input f iles :... hinf lim. mat 

% output f lies: ... tf liml/2 . mat , contdiscliml/ 2 /a/q . met , trueliml/2/a/q.roat 



% "THIS M-FILE CREATES DISCRETE & CONTINUOUS BODE PLOTS FOR THE PLANT 
% STATE REPRESENTATION OF Hinf LIMITED PERFORMANCE X-29 model, CASE #2 . 
% Altitude = 30000 feet 
% Mach# = .5 



The A,B,C and D matrices are first balanced to measure a reasonable condition 
number for the A matrix, then converted from a continuous to a discrete state 
space model using Ts=0.02 sec as the sampling time, and finally converted to 
a transfer function form using, 



H ( z ) = C*inv ( zI-A) *B= Y(z)/U(z) 



( 1 ) 



By replacing the z-transform with the 1/q backward shift operator, the 
numerator and denominator terms of that transformation may be used to obtain 
the DARMA model, 



A (q) y ( t ) = B(q)u(t) 

Reworking equation (2) gives [Ref. 7:pp. 71-72], 

y(t) = B (q) u ( t ) - ( A (q) 



i)y(t) 



( 2 ) 



(3) 



Expanding the matrix polynomials and rearranging it to obtain two recursive 
equations of the form similar to equation (3.8) of Chapter III gives, 

Vi (t) = SUMj [Bi j *Uj (t-j) - SUM j [ Aj *Y j (t-j) ] (4) 

where SUM indicates a summation operation 
i indicates the number of outputs 

j indicates the number of past input and output measurements 

Aj terms are the denominator coefficients 
Bij terms are the numerator coefficients 



% The algorithm referring to the control input in USERIO of the case request 
% RQ_LEARNRSLT of Appendix A, is represented by equation (4). Control [j] 

% specifies the first 30 elements of the control layer, which are the past 30 
% inputs, [Uj(t-j)], whereas control [30*(i+l)+j] specifies the second and the 
% third block of 30 elements, which are the past 30 outputs, [Yj(t-j)], for 
% each of the two ouput elements. 

% Finally, the coefficients for B(q) and A(q)-1 matrices of equation (3) 

% are represented in the Transfer. h files as the numerator and denominator 
% coefficients for both cases, Optimal and Limited performance. 



% get the a,b,c & d matrices 

load hinflim.mat 

a=acgf ; 
b=bcgf ; 
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c=ccgf ; 
d=dcgf ; 

% balance a # b and c matrices, 
[ab, bb, cb, g , t ]=obalreal (a , b, c) ; 



% compute continuous Bode 

disp(' calculating continuous Bode please wait') 

w=logspace (-3 , 2 , 1024 ) ; 

[mage, phasec]=bode (ab, bb, cb,d, 1 , w) ; 
mag=20*log!0 (mag) ; 



% Compute discrete time system 
t=. 02 ; % SAMPLING TIME 

[ ad, bd ]=c2d (ab, bb, t) ; 

% Compute transfer function for the two inputs 

[numl ,denl ] s =ss2tf(ad,bd,cb,d,l) ; 

[num2 ,den2 ] =ss2tf (ad , bd , cb, d , 2 ) ; 



%save tfliml numl deni 
%save tflim2 num2 den2 



% Discrete Bode plot calculations 
disp ( ' ' ) 

disp(' calculating discrete Bode Nyquist 50Hz T=.02 ') 



[mag , phase ]=dbode (ad, bd, cb, d, l,w) ; 
log log (w,magc ( : , 1) , 50*w,mag ( : , 1) ) 

title('X-29 Continuous and Discrete Alpha Frequency Response') 
title (' Optimal case - input 1 ') 

xlabel (' Altitude = 30000 feet frequency (Hz) Mach =.5'), 

ylabel (' magnitude ') 

text (0 . 01 ,. 0001 ,' continuous ') 

text(. 01, .00001, 'discrete ') 

meta contdisclimla 
pause 



log log (w,magc ( : ,2) , 50 *w, mag ( : , 2 ) ) 

title ('X-29 Continuous and Discrete Q Frequency Response ') 
title (' Optimal case - input 2 ') 

xlabel ( 'Altitude = 30000 feet frequency (Hz) Mach =.5'), 

ylabel (' magnitude ') 

text (0. 1, . 001, 'continuous ') 

text (. 1 ,. 0003 , 'discrete ') 
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meta contdisclimlq 



f=w; 

m=mag ( : , 1) ; 

%save truelimla f m 

m=mag ( : , 2 ) ; 

%save truelimlq f m 



177 



% wgtm.m 



% This matlab file calculates the SVD of the weight matrices, 

% which are composed of the connections weights between the 
% two hidden layers. The first hidden layer has 42 elements 
% and the second hidden layer has been tested with 30, 21, 

% 12, 8 and 5 elements. 

% The input .nnp files are from the optimal controller network 1 
% of case 06 or case6h2.nnd. 



load c6h230.nnp 
load c6h221.nnp 
load c6h212.nnp 
load c6h28.nnp 
load c6h251.nnp 
load c6h22.nnp 

[m,nl]=size (c6h230) ; 
[m,n2 ]=size (c6h221) ; 

[m, n3 ]=size (c6h212 ) ; 

[m, n4 ]=size (c6h28) ; 

[m, n5 ]=size (c6h251 ) ; 

[m, n6 ]=size (c6h22 ) ; 

tf I=c6h2 3 0 ( : ,3:nl) ; 
t f 2=c6h2 2 1 ( : , 3 : n 2 ) ; 
tf 3=c6h212 ( : , 3 :n3) ; 
tf 4=c6h28 ( : , 3 sn4) ; 
tf 5=c6h2 5 1 ( : ,3:n5) ; 
tf 6=c6h2 2 ( : ,3:n6) ; 

t=0: 100:9900; 

al=zeros ( (nl-2 ) /30, 30) ; 
a2=zeros ( ( n2-2 ) / 2 1 , 2 1 ) ; 
a3=zeros ( ( n3 -2 ) / 12 , 12 ) ; 
a 4= zeros ( (n4-2 ) /8 , 8 ) ; 
a 5= zeros ( (n5-2) /5,5) ; 
a 6= zeros ( ( n6-2 ) / 2 , 2 ) ; 



for i=l 


in 


al( 


) =tf 1 ( i , : ) ; 


sl( 


, i)=svd(al) ; 


a2( 


) =tf 2 ( i , : ) ; 


S2 ( 


, i)=svd(a2) ; 


a3( 


) = tf 3 ( i , : ) ; 


S3( 


, i)=svd(a3) ; 


a4 ( 


) =tf 4 (i , : ) ; 


s4 ( 


, i)=svd(a4) ; 


a5( 


) =tf 5 ( i , : ) ; 


S5( 


,i)=svd(a5) ; 


a 6 ( 


) =tf 6 ( i , : ) ; 


s6( 


, i)=svd(a6) ; 



end; 



i=f ind ( sl< . 6) ; 
si ( i) =zeros (i); 
i=f ind ( s2< . 54 ) ; 



% Load the .nnp files. 



% Obtain the size of each matrix. 



% Get rid-off the first two elements. 



% Time vector. 

% Divide the matrix into blocks of which 
% the number of columns equals the number 
% of elements in the second hidden layer. 



% Calculate the actual SVD's. 



% Get rid-off the insignificant values. 
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s2 ( i) =zeros ( i) ; 
i=f ind ( s3< .45) ; 
s3 ( i ) =zeros ( i ) ; 
i=f ind (s4< . 39 ) ; 
s4 (i ) =zeros ( i) ; 
i=f ind ( s5< .35) ; 
s5 ( i ) =zeros (i) ; 
i=f ind ( s6< . 30) ; 
s6 (i) =zeros ( i) ; 

axis ( [ 0 10000 0.1 6]) 

plot(t, si' , ) 

title('SVD plot of the wgt matrix (hidden 2 

xlabel (' Number of Epochs') 

ylabel('SVD') 

meta svd41 

pause 

plot ( t , s2 ' , ' ) 

title('SVD plot of the wgt matrix (hidden 2 

xlabel (' Number of Epochs') 

y label ( 'SVD' ) 

meta svd42 

pause 

plot (t,s3 ','-') 

title ( ' SVD plot of the wgt matrix (hidden 2 

xlabel ( ' Number of Epochs ' ) 

y label ( 'SVD' ) 

meta svd43 

pause 

plot ( t , s5 ' , ' - ' ) 

title ( ' SVD plot of the wgt matrix (hidden 2 

xlabel (' Number of Epochs') 

ylabel ( 'SVD' ) 

meta svd44 

pause 



plot (t,s6' , '-' ) 

title ('SVD plot of the wgt matrix (hidden 2 

xlabel ( 'Number of Epochs') 

ylabel ( ' SVD ' ) 

meta svd45 

pause 



- 30 elements) ' ) 



- 21 elements) ' ) 



- 12 elements) ' ) 



- 5 elements) ' ) 



- 2 elements) ' ) 
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% spcallim.m 

% input f iles : . . . inputlin\l/2 . nnp, plantliml/2 . nnp 
% output f iles :... specliml/2 .mat 



% THIS M-FILE CREATES THE SPECTRUM RETURNS OF CASE /2 OF BOTH INPUTS 
% WITH A 5 ARRAYS FUNCTION P= [ Pxx , Pyy , Pxy , Txy , Cxy ] WHERE Txy IS THE 
% COMPLEX TRANSFER FUNCTION FROM X TO Y. P=SPECTRUM (X , Y , M) WHERE X= INPUT 
% VECTOR, Y=OUTPUT VECTOR, AND M=2048 PTS, WHICH DIVIDES BOTH VECTORS INTO 
% SECTIONS OF 2048 POINTS EACH. 

% PERFORM SPECTRAL ANALYSES ON THE TWO SEQUENCES X AND Y. 



load inputliml . nnp 
load plantliml . nnp 
load inputlim2 . nnp 
load plantlim2 . nnp 

xl=inputliml ( 1 : 2049 , 3 ) ; 
yl=plantliml (1 : 2049 , 3 ) ; 
zl=plantliml (1:204 9,4) ; 
x2=inputlim2 (1 : 2049 , 3) ; 
y2=plantlim2 (1:2049, 3) ; 
z2=plantlim2 (1: 2049,4) ; 

clear inputliml pilantliml inputlim2 plantlim2 
disp ( 1) 

Pal=spectrum(xl ,yl , 2048 , 1024 ) ; 
disp ( 2 ) 

Pql=spectrum (xl , zl , 2048 , 1024 ) ; 
disp ( 3 ) 

Pa2=spectrum(x2 ,y2 , 2048 , 1024 ) ; 
disp ( 4 ) 

Pq2=spectrum(x2 , z2 , 2048 , 1024 ) ; 

save specliml Pal Pql; 
save speclim2 Pa2 Pq2; 
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% splotsliml.m 



% input files: . . . sped iml / 2 . mat , trueliml/2/a/q .mat 
% output files:... TFliml/2/a/q.met 

% THIS M-FILE COMPARES THE SYSTEM AND NETWORK ALPHA AND Q "FREQUENCY" RESPONSES 
% FOR CASE #2 (LIMITED CASE) WITH RESPECT TO THE TWO INPUTS. 



load sped iml; 
load speclim2; 

[n, m] = size (Pal) ; 
Fs=100 ; 

fl = ( 1 : n-1) /n*Fs/2 ; 



load truelimla; 

log log (pi*f 1 , abs (Pal (2 : n , 4 ) ) , 50*f , m) 

title ('Txy - Transfer function for Alpha (Limited case -input 1)') 
xlabelf' Altitude= 30,000 feet frequency (hz ) Mach= 0.5 ') 

ylabel ( 'Magnitude' ) 

text ( 1 . 0 ,. 001 , 'True system ') 

text ( 1 . 0 ,. 0005 ,' 40k cycles ') 

meta TFlimal 
pause 



load truelimlq; 

loglog(pi*fl,abs(Pql(2:n,4) ) , 50*f , m) , . . . 

title ('Txy - Transfer function for Q (Limited case -input 1)') 
xlabel(' Altitude= 30,000 feet frequency (hz ) Mach= 0.5 ') 

ylabel ( ' Magnitude ' ) 

text (0 . 3 , . 02 , ' True system ') 

text (0 . 3 , . 008 , ' 4 0k cycles ') 

meta TFlimql 
pause 

load truelim2a; 

log log (pi*f 1 , abs (Pa2(2:n,4) ) , 50*f ,m) 

title('Txy - Transfer function for Alpha (Limited case -input 2)') 
xlabel(' Altitude= 30,000 feet frequency (hz ) Mach= 0.5 ') 

ylabel ( 'Magnitude' ) 

text ( 1 . 0 ,. 001 ,' True system ') 

text ( 1 . 0 , . 0005 , ' 4 0k cycles ') 

meta TFlima2 
pause 



load truelim2q; 

loglog (pi* f l , abs (Pq2 ( 2 : n , 4 ) ) ,50*f ,m) , ... 

title('Txy - Transfer function for Q (Limited case -input 2)') 
xlabel(' Altitude= 30,000 feet frequency (hz ) Mach= 0.5 ') 

ylabel ( 'Magnitude ' ) 

text (0 . 3 , . 02 , 'True system ') 

text ( 0 . 3 , . 008 , ' 40k cycles ') 

meta TFlimq2 
pause 
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I liml.m 

I input f iles : . . . hinf lim. mat , stepliml/2 . nnp 
% ouput f iles: ... liml/2/a/q. met 

% THIS M-FILE COMPARES THE SYSTEM AND NETWORK ALPHA & Q "TIME” RESPONSE FOR 
% CASE /2 (LIMITED CASE) WITH RESPECT TO THE TWO INPUTS. 

load hinf lim. mat 
load stepliml . nnp 
load steplim2 .nnp 
format long e 

vl=stepliml (1:251,3) ; 
zl=stepliml (1:251,4) ; 
v2=steplim2 (1:251,3); 
z2=steplim2 (1:251,4) ; 

clear stepliml steplim2 

timel= [ 0 : 0 . 02 : 5 ] ; % for the network response 



I ul- input 1 and u2- input 2. 

ul= [ ones (1,101) zeros (1,300) ; zeros (1,401)]'; 
u2= [ zeros ( 1 , 4 01 ) ; ones (1,101) zeros (1,300)]'; 

[yl]=lsim(acgf, bcgf , ccgf , dcgf , ul , timel) ; 

[y2 ]=lsim (acgf , bcgf , ccgf , dcgf , u2 , timel) ; 



plot (timel , yl ( : , 1 ) , timel , zl) 

title ( ' X-29 DESIRED AND ACTUAL ALPHA RESPONSE (limited case -input 1)') 
xlabel ( 'TIME - SEC') 
ylabel ( 'DEGREES' ) 

text(1.75, . 6, 'Desired ') 

text ( . 5, . 12, 'Actual ' ) 

grid 

%meta limla 
pause 

plot (timel , yl ( : ,2) , timel ,vl) 

title ( 'X-29 DESIRED AND ACTUAL Q RESPONSE ( limited case -input 1)') 
xlabel ('TIME - SEC' ) 
ylabel ( 'DEGREES' ) 

text ( 1 . 75, . 6 ,' Desired ') 

text (. 5, . 12 ,' Actual ') 

grid 

Imeta limlq 
pause 

plot (timel, y 2 ( : , 1) , timel, z2) 

title ( ' X-29 DESIRED AND ACTUAL ALPHA RESPONSE (limited case -input 2)') 
xlabel( 'TIME - SEC' ) 
ylabel ('DEGREES') 

text(l. 75, .6, 'Desired ') 

text (. 5 ,. 12 , 'Actual ') 

grid 

%meta lim2a 
pause 
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plot (time 1 , y2 ( : , 2 ) , timel , w2 ) 

title ( ' X-29 DESIRED AND ACTUAL Q RESPONSE ( limited case -input 2)') 
xlabel ( ' TIME - SEC') 
y label ( 'DEGREES' ) 

text ( 1 . 75 6 Desired ') 

text ( .5, .12, 'Actual ' ) 

grid 

%meta lim2q 
pause 
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